-- Logs begin at Wed 2021-10-13 03:39:47 UTC, end at Wed 2021-10-13 04:36:08 UTC. -- Oct 13 04:09:05.553646 dv-cinder-812751-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 13 04:09:05.563444 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 13 04:09:05.565456 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 13 04:09:05 2021] *** Oct 13 04:09:05.565456 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 13 04:09:05.565456 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 13 04:09:05.565456 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: nodename: dv-cinder-812751-3-iscsi Oct 13 04:09:05.565456 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: machine: x86_64 Oct 13 04:09:05.565456 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: clock source: unix Oct 13 04:09:05.565456 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: pcre jit disabled Oct 13 04:09:05.565456 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: detected number of CPU cores: 4 Oct 13 04:09:05.565456 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: current working directory: / Oct 13 04:09:05.565456 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: detected binary path: /usr/bin/uwsgi-core Oct 13 04:09:05.565456 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: your processes number limit is 47680 Oct 13 04:09:05.565456 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: your memory page size is 4096 bytes Oct 13 04:09:05.565456 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: detected max file descriptor number: 2048 Oct 13 04:09:05.565456 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: lock engine: pthread robust mutexes Oct 13 04:09:05.566453 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: thunder lock: enabled Oct 13 04:09:05.566453 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 13 04:09:05.566453 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 13 04:09:05.614132 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: Python main interpreter initialized at 0x5562891ef9c0 Oct 13 04:09:05.614132 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: python threads support enabled Oct 13 04:09:05.614132 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: your server socket listen backlog is limited to 100 connections Oct 13 04:09:05.614132 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: your mercy for graceful operations on workers is 90 seconds Oct 13 04:09:05.614511 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: mapped 403077 bytes (393 KB) for 2 cores Oct 13 04:09:05.614511 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: *** Operational MODE: preforking *** Oct 13 04:09:05.614809 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: *** uWSGI is running in multiple interpreter mode *** Oct 13 04:09:05.614809 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: spawned uWSGI master process (pid: 93326) Oct 13 04:09:05.615025 dv-cinder-812751-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 13 04:09:05.616259 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: spawned uWSGI worker 1 (pid: 93327, cores: 1) Oct 13 04:09:05.616259 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: spawned uWSGI worker 2 (pid: 93328, cores: 1) Oct 13 04:09:05.616259 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 13 04:09:07.240761 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 04:09:07.240761 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: from cryptography.utils import int_from_bytes Oct 13 04:09:07.241472 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 04:09:07.241472 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: from cryptography.utils import int_from_bytes Oct 13 04:09:07.241728 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 04:09:07.241728 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: from cryptography.utils import int_from_bytes Oct 13 04:09:07.241728 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 04:09:07.241728 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: from cryptography.utils import int_from_bytes Oct 13 04:09:09.810984 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 04:09:09.811564 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 04:09:09.811564 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 04:09:09.811951 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 04:09:09.812208 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 04:09:09.812586 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.812715 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 04:09:09.813081 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.813169 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 04:09:09.813256 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.813459 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 04:09:09.813598 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.813840 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.813990 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 04:09:09.814079 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 04:09:09.814156 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.814441 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.814579 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.814731 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.814821 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.815076 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.815223 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.815321 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.815409 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.815603 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.815702 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.815950 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812751-3-iscsi {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.816081 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.816268 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.816422 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.816544 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.816637 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.816875 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.817017 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.817156 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.817269 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.817449 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.817554 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.817818 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.817950 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812751-3-iscsi {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.818117 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.818261 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.818434 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.818585 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.819004 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.819095 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.819174 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.819315 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.819408 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.819634 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.819718 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.819938 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.820085 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.820244 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.820442 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.820590 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.820721 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.820852 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.821091 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.821226 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.821414 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.821554 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.821780 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.821923 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.822097 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.822224 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812751-3-iscsi {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.822409 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.822550 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.822735 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.822866 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.823043 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.823169 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.823369 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.823505 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.823679 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.823806 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.824049 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.824174 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812751-3-iscsi {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.824364 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.824492 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.824681 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.824828 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.824964 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.825095 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.825286 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.825421 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.825583 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.825820 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.825943 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.826077 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.826232 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.826360 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.826545 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.826674 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.826847 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.826974 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.827147 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.827282 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.827463 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.827591 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.827759 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.827885 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.828062 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.828278 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.828404 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.828532 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.828654 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.828782 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.828911 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.829042 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.829169 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.829384 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.829512 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.829705 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.829834 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.830022 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.830149 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.830273 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.830397 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.830567 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.830703 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.830895 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.831028 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.831217 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.831352 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.831545 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.831683 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.831805 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.831927 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.832048 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.832179 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.832314 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.832438 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.832640 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.832775 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.832952 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.833079 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.833263 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.833391 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.833571 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.833725 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.833917 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.834044 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.834224 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.834352 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.834527 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.834652 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.834835 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.834962 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.835142 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.835270 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.835446 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.835580 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.835827 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.835967 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.836098 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.836226 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.836350 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.836473 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.836693 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.837009 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.837135 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.837310 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.837512 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.837670 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.837794 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.837943 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.838098 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.838224 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.838453 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.838581 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.838776 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.838913 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.839037 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.839157 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.839321 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.839449 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.839632 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.839770 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.839943 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.840078 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.840239 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.840378 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.840539 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.840667 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.840853 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.840982 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.841159 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.841294 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.841425 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.841554 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.841757 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.841931 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.842069 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.842191 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.842353 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.842480 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.842663 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.842788 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.842967 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.843095 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.843261 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.843393 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.843568 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.843702 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.843835 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.843969 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.844159 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.844284 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.844471 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.844605 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.844758 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.844895 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.845074 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.845201 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.845371 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.845501 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.845704 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.845850 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.846056 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.846293 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.846418 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.846538 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.846664 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.846798 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.846919 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.847049 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.847172 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.847298 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.847450 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.847587 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.847772 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.847902 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.848067 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.848200 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.848380 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.848516 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.848696 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.848833 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.848984 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.849113 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.849294 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.849433 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.849587 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.849760 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.849913 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.850054 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.850216 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.850353 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.850514 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.850642 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.850823 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.850951 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.851123 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.851260 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.851389 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.851519 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.851704 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.851826 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.852004 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.852189 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.852324 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.852446 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.852650 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.852777 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.852963 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.853090 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.853265 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.853390 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.853567 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.853730 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.853866 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.853997 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.854188 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.854322 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.854485 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.854614 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.854815 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.854946 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.855069 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.855190 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.855391 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.855521 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.855713 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.855841 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.856006 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.856220 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.856354 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.856485 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.856610 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.856732 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.856927 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:09:09.857062 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.857260 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.857396 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.857569 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.857755 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.857881 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.858011 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.858195 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.858332 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.858510 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.858640 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.858823 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.858951 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.859152 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.859281 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.859463 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.859597 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.859778 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.859906 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.860091 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.860219 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.860396 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.860523 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.860716 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.860852 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.861026 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.861162 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.861339 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.861472 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.861656 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.861786 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.862008 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.862138 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.862328 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.862463 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.862635 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.862770 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.862938 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.863072 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.863254 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.863388 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.863573 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.863700 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.863891 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.864018 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.864202 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.864345 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.864474 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.864597 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.864809 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.864940 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.865121 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.865249 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.865435 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.865572 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.865778 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.865907 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.866089 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.866231 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.866420 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.866555 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.866688 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.866812 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.866972 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.867101 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.867287 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.867424 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.867596 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.867724 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.867921 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.868051 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.868241 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.868381 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.868563 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.868694 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.868865 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.868999 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.869189 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.869319 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.869495 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.869645 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.869828 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.869970 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.870103 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.870227 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.870405 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.870530 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.870718 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.870840 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.871023 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.871154 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.871325 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.871451 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.871645 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.871771 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.871960 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.872085 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.872262 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.872388 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.872582 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.872704 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.872883 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.873016 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.873182 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.873309 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.873496 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.873671 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.873824 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.873949 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.874131 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.874262 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.874435 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.874569 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.874754 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.874888 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.875062 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.875186 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.875366 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.875504 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.875681 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.875804 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.875989 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.876114 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.876296 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.876443 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.876636 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.876761 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.876913 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.877051 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.877256 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.877386 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.877510 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.877691 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.877819 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.877941 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.878115 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.878248 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.878416 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.878550 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.878719 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.878853 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.879026 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.879159 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.879328 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.879453 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.879631 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.879759 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.879934 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.880053 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.880237 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.880362 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.880536 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.880662 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.880855 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.880991 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.881162 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.881287 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.881466 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.881599 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.881791 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.881916 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.882096 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.882220 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.882433 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.882570 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.882733 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.882857 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.883040 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.883163 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.883369 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.883503 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.883723 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.883850 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.884041 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.884166 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.884353 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.884487 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.884668 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.884806 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.884972 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.885095 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.885275 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.885408 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.885582 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.885769 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.885914 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.886039 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.886229 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.886356 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.886535 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.886673 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.886862 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.886988 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.887141 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.887267 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.887459 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.887592 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.887766 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.887899 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.888080 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.888207 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.888378 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.888496 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.888691 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.888816 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.889015 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.889140 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.889331 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.889464 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.889661 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.889788 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.889980 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.890101 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.890288 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.890413 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.890598 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.890733 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.890904 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.891029 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.891210 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.891336 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.891515 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.891650 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.891819 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.891945 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.892138 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.892263 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.892444 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.892578 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.892760 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.892885 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.893068 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.893192 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.893385 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.893520 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.893715 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.893851 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.894029 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.894152 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.894327 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.894465 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.894635 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.894761 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.894952 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.895074 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.895406 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.895533 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.895638 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.895748 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.895872 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.896004 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.896164 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.896291 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.896469 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.896596 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.896777 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.896980 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.897116 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.897244 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.897373 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.897495 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.897679 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.897807 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.897991 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.898117 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.898302 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.898427 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.898610 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.898746 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.898914 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.899040 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.899248 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.899374 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.899560 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.899698 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.899865 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.899990 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.900168 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.900292 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.900468 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.900605 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.900775 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.900901 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.901088 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.901219 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.901394 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.901526 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.901728 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.901882 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.902039 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.902162 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.902340 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.902476 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.902642 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.902767 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.902952 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.903074 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.903253 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.903377 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.903554 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.903679 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.903855 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.903979 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.904154 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.904279 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.904485 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.904607 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.904788 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.904912 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.905089 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.905216 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.905391 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.905514 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.905727 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.905853 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.906058 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.906181 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.906331 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.906455 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.906634 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.906756 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.906937 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.907139 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.907276 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.907398 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.907527 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.907659 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.907831 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.907965 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.908139 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.908272 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.908447 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.908580 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.908754 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.908879 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.909060 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.909185 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.909375 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.909512 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.909693 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.909817 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.909999 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.910124 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.910305 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.910447 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.910603 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.910728 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.910910 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.911035 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.911221 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.911351 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.911536 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.911788 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.911919 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.912124 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.912258 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.912441 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.912566 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.912760 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.912884 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.913071 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.913204 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.913380 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.913505 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.913720 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.913857 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.914041 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.914178 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.914350 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.914657 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.914812 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.915000 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.915325 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.915457 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.915649 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.915816 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.915975 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.916273 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.916408 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.916593 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.917071 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.917278 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.917404 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.917557 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.917739 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.917887 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.918012 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.918197 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.918329 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.918500 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.918635 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.918807 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.918931 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.919118 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.919249 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.919430 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.919565 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.919739 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.919875 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.920040 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.920175 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.920349 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.920472 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.920650 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.920773 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.920954 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.921076 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.921267 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.921389 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.921573 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.921725 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.921901 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.922037 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.922211 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.922336 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.922526 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.922663 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.922835 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.922959 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.923162 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.923287 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.923474 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.923607 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.923783 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.923909 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.924091 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.924215 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.924399 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.924531 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.924723 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.924849 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.925028 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.925161 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.925331 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.925457 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.925650 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.925779 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.925963 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.926089 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.926272 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.926398 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.926571 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.926696 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.926878 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.927003 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.927187 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.927395 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.927521 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.927645 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.927787 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.927964 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.928091 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.928221 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.928380 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.928506 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.928681 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.928815 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.928991 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.929116 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.929296 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.929421 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.929598 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.929754 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.929923 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.930048 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.930251 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.930383 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.930558 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.930762 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.930888 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.931012 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.931133 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.931255 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.931435 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.931575 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.931746 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.931871 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.932048 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.932171 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.932347 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.932471 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.932649 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.932774 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.932949 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.933079 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.933252 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.933376 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.933551 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.933693 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.933891 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.934014 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.934196 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.934321 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.934496 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.934621 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.934799 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.934932 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.935096 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.935221 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.935394 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.935526 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.935700 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.935835 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.936021 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.936147 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.936329 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.936444 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.936628 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.936760 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.936935 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.937057 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.937236 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.937360 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.937570 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.937756 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.937881 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.938010 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.938132 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.938261 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.938424 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.938562 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.938728 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.938853 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.939030 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.939156 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.939331 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.939470 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.939629 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.939754 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.939936 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.940058 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.940241 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.940365 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.940541 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.940664 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.940839 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.940962 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.941140 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.941266 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.941440 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.941569 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.941777 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.941901 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.942101 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.942228 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.942412 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.942538 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.942718 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.942842 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.943025 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.943150 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.943330 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.943452 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.943640 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.943766 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.943950 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.944076 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.944251 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.944384 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.944565 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.944701 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.944874 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.945007 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.945183 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.945308 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.945485 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.945650 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.945834 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.946018 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.946181 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.946306 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.946487 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.946622 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.946793 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.946923 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.947106 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.947228 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.947423 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.947576 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.947766 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.947893 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.948018 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.948139 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.948321 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.948454 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.948629 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.948754 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.948934 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.949073 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.949240 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.949365 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.949545 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.949701 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.949881 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.950007 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.950190 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.950323 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.950499 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.950626 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.950807 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.950934 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.951114 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.951237 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.951412 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.951543 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.951720 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.951844 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.952030 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.952162 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.952328 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.952453 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.952639 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.952770 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.952943 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.953077 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.953245 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.953377 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.953947 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.954093 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.954093 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.954326 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.954448 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.954568 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.954689 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.954819 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.954819 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.955052 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.955183 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.955305 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.955426 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.955559 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.955684 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.955806 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.955965 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.956089 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.956280 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.956406 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.956588 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.956711 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.956907 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.957043 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.957211 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.957337 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.957635 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.957777 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.957967 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.958091 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.958231 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.958356 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.958527 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.958653 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.958828 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.958952 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.959163 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.959289 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.959417 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.959539 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.959719 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.959843 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.960020 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.960153 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.960326 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.960451 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.960627 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.960760 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.960943 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.961105 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.961228 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.961350 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.961573 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.961733 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.962010 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.962140 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.962317 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.962468 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.962654 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.962789 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.962959 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.963082 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.963287 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.963411 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.963597 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.963734 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.963923 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.964041 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.964257 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.964387 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.964576 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.964702 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.964880 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.965005 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.965189 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.965339 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.965496 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.965809 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.965930 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.966129 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.966252 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.966447 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.966566 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.966758 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.966878 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.967062 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.967382 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.967696 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.968019 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.968175 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.968324 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.968498 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.968735 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.968890 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.969055 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.969182 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.969361 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.969494 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.969705 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.969847 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.970030 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.970155 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.970333 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.970466 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.970637 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.970770 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.970944 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.971069 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.971247 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.971383 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.971552 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.971678 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.971872 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.972010 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.972179 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.972372 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.972497 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.972704 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.972837 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.973021 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.973148 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.973348 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.973473 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.973670 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.973798 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.973993 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.974121 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.974295 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.974434 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.974607 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.974740 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.974916 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.975043 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.975231 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.975353 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.975541 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.975672 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.975844 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.975968 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.976158 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.976290 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.976463 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.976596 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.976767 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.976900 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.977086 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.977252 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.977440 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.977574 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.977796 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.977921 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.978126 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.978259 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.978433 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.978572 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.978756 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.978881 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.979084 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.979211 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.979412 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.979537 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.979722 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.979854 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.980050 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.980176 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.980366 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.980494 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.980676 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.980800 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.980987 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.981111 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.981286 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.981411 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.981589 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.981772 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.981920 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.982057 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.982228 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.982356 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.982534 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.982659 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.982835 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.982960 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.983143 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.983270 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.983446 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.983570 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.983748 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.983882 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.984050 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.984176 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.984370 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.984497 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.984672 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.984811 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.984990 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.985115 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.985298 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.985424 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.985601 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.985764 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.985925 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.986057 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.986228 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.986353 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.986546 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.986680 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.986855 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.986980 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.987157 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.987279 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.987471 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.987601 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.987779 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.987904 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.988103 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.988312 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.988452 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.988574 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.988720 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.988845 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.989030 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.989153 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.989340 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.989466 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.989681 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.989810 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.989983 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.990116 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.990295 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.990419 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.990612 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.990746 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.990928 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.991060 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.991237 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.991363 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.991553 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.991677 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.991868 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.992003 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.992181 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.992312 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.992517 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.992732 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.992862 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.993062 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.993182 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.993373 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.993498 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.993708 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.993843 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.994024 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.994150 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.994339 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.994471 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.994652 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.994777 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.994965 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.995091 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.995277 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.995402 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.995587 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.995721 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.995899 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.996026 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.996229 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.996463 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.996589 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.996799 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.996933 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.997119 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.997245 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.997438 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.997564 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.997783 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.997911 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.998103 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.998229 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.998435 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.998570 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.998725 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.998849 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.999041 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.999172 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.999346 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.999519 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.999646 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.999766 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:09.999961 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.000084 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.000274 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.000401 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.000590 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.000716 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.000900 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.001025 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.001214 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.001342 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.001526 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.001681 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.001856 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.001985 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.002170 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.002299 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.002484 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.002609 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.002796 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.002931 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.003117 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.003243 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.003441 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.003566 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.003757 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.003894 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.004069 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.004195 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.004379 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.004498 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.004692 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.004830 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.005006 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.005206 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.005339 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.005520 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.005710 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.005879 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.006005 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.006203 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.006328 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.006525 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.006727 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.006854 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.006976 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.007145 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.007279 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.007472 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.007606 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.007777 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.007902 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.008080 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.008206 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.008475 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.008618 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.008751 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.008969 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.009094 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.009292 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.009430 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.009666 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.009793 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.009972 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.010097 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.010290 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.010428 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.010600 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.010730 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.010938 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.011129 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.011277 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.011479 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.011617 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.011797 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.011922 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.012126 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.012252 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.012448 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.012575 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.012763 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.012891 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.013066 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.013200 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.013386 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.013514 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.013713 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.013841 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.014017 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.014217 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.014342 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.014472 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.014623 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.014856 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.014983 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.015209 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.015336 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.015515 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.015639 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.015821 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.015956 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.016122 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.016256 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.016429 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.016556 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.016731 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.016866 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.017054 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.017180 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.017354 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.017489 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.017678 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.017818 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.017982 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.018109 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.018291 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.018416 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.018625 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.018767 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.018891 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.019014 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.019176 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.019309 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.019477 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.019611 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.019782 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.019905 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.020079 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.020204 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.020385 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.020519 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.020684 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.020816 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.020992 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.021116 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.021292 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.021418 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.021595 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.021750 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.021920 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.022049 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.022234 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.022359 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.022533 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.022656 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.022833 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.022959 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.023137 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.023262 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.023442 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.023564 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.023745 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.023876 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.024079 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.024205 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.024386 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.024518 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.024703 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.024828 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.025011 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.025149 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.025325 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.025534 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.025688 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.025904 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.026041 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.026259 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.026383 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.026567 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.026694 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.026888 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.027014 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.027201 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.027328 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.027500 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.027632 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.027805 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.027931 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.028122 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.028247 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.028432 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.028558 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.028774 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.028907 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.029050 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.029299 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.029424 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.029664 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.029794 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.029973 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.030096 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.030282 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.030419 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.030592 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.030720 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.030901 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.031036 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.031237 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.031362 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.031558 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.031686 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.031872 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.031997 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.032187 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.032312 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.032504 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.032628 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.032811 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.032961 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.033122 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.033264 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.033429 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.033553 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.033760 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.033886 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.034074 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.034211 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.034391 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.034516 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.034699 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.034817 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.035002 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.035138 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.035353 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.035484 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.035677 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.035808 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.035998 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.036130 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.036313 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.036438 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.036621 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.036746 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.036935 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.037081 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.037252 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.037377 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.037559 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.037728 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.037903 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.038028 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.038209 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.038340 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.038535 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.038660 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.038881 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.039015 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.039167 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.039291 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.039495 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.039675 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.039849 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.039975 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.040154 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.040279 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.040455 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.040593 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.040763 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.040889 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.041093 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.041241 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.041406 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.041546 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.042154 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.042281 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.042478 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.042603 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.042814 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.042940 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.043140 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.043271 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.043460 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.043586 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.043775 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.043900 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.044080 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.044206 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.044385 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.044508 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.044695 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.044821 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.045009 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.045136 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.045319 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.045446 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.045650 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.045780 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.045959 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.046086 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.046269 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.046404 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.046580 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.046714 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.046892 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.047015 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.047215 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.047347 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.047519 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.047646 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.047841 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.047968 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.048151 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.048287 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.048466 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.048599 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.048780 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.048905 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.049115 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.049242 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.049393 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.049517 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.049727 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.049863 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.050039 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.050164 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.050353 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.050478 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.050660 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.050784 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.050977 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.051103 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.051291 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.051424 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.051614 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.051739 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.051932 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.052056 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.052261 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.052383 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.052580 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.052712 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.052899 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.053024 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.053217 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.053348 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.053534 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.053688 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.053892 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.054017 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.054139 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 04:09:10.054260 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.054507 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.054830 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.055149 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.055532 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.055862 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.056193 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.056523 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.056872 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.057190 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.057538 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.057896 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:09:10.058144 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 04:09:10.077097 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG oslo_db.sqlalchemy.engines [None req-b6a00027-eb3f-4651-9086-8aebc519ff72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:09:10.080049 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_db.sqlalchemy.engines [None req-4f4355f0-407a-4c13-b27f-c5119edeadec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:09:10.253252 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.context [None req-b6a00027-eb3f-4651-9086-8aebc519ff72 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),44898ae1-31ba-46fa-a097-287ffc9bdaf3(cell1) {{(pid=93327) load_cells /opt/stack/nova/nova/context.py:464}} Oct 13 04:09:10.256131 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.context [None req-4f4355f0-407a-4c13-b27f-c5119edeadec None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),44898ae1-31ba-46fa-a097-287ffc9bdaf3(cell1) {{(pid=93328) load_cells /opt/stack/nova/nova/context.py:464}} Oct 13 04:09:10.257860 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG oslo_concurrency.lockutils [None req-b6a00027-eb3f-4651-9086-8aebc519ff72 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:09:10.260057 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG oslo_concurrency.lockutils [None req-b6a00027-eb3f-4651-9086-8aebc519ff72 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:09:10.260665 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-4f4355f0-407a-4c13-b27f-c5119edeadec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:09:10.260890 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG oslo_concurrency.lockutils [None req-b6a00027-eb3f-4651-9086-8aebc519ff72 None None] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:09:10.262859 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG oslo_concurrency.lockutils [None req-b6a00027-eb3f-4651-9086-8aebc519ff72 None None] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:09:10.262994 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-4f4355f0-407a-4c13-b27f-c5119edeadec None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:09:10.263712 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-4f4355f0-407a-4c13-b27f-c5119edeadec None None] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:09:10.265646 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-4f4355f0-407a-4c13-b27f-c5119edeadec None None] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:09:10.274503 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG oslo_db.sqlalchemy.engines [None req-b6a00027-eb3f-4651-9086-8aebc519ff72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:09:10.276241 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG oslo_db.sqlalchemy.engines [None req-b6a00027-eb3f-4651-9086-8aebc519ff72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:09:10.279560 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_db.sqlalchemy.engines [None req-4f4355f0-407a-4c13-b27f-c5119edeadec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:09:10.281939 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_db.sqlalchemy.engines [None req-4f4355f0-407a-4c13-b27f-c5119edeadec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:09:10.533729 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG oslo_db.sqlalchemy.engines [None req-b6a00027-eb3f-4651-9086-8aebc519ff72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:09:10.541110 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_db.sqlalchemy.engines [None req-4f4355f0-407a-4c13-b27f-c5119edeadec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:09:10.871703 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: WARNING keystonemiddleware.auth_token [None req-4f4355f0-407a-4c13-b27f-c5119edeadec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 04:09:10.874058 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: WARNING keystonemiddleware.auth_token [None req-b6a00027-eb3f-4651-9086-8aebc519ff72 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 04:09:10.878120 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: WARNING keystonemiddleware.auth_token [None req-4f4355f0-407a-4c13-b27f-c5119edeadec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 04:09:10.880611 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: WARNING keystonemiddleware.auth_token [None req-b6a00027-eb3f-4651-9086-8aebc519ff72 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 04:09:11.223576 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: WARNING keystonemiddleware.auth_token [None req-4f4355f0-407a-4c13-b27f-c5119edeadec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 04:09:11.225309 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: WARNING keystonemiddleware.auth_token [None req-b6a00027-eb3f-4651-9086-8aebc519ff72 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 04:09:11.228828 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: WARNING keystonemiddleware.auth_token [None req-4f4355f0-407a-4c13-b27f-c5119edeadec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 04:09:11.230563 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: WARNING keystonemiddleware.auth_token [None req-b6a00027-eb3f-4651-9086-8aebc519ff72 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 04:09:11.234167 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5562891ef9c0 pid: 93328 (default app) Oct 13 04:09:11.235842 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5562891ef9c0 pid: 93327 (default app) Oct 13 04:09:11.236228 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-4f4355f0-407a-4c13-b27f-c5119edeadec None None] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:09:11.237385 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-4f4355f0-407a-4c13-b27f-c5119edeadec None None] 10.222.0.55 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001712 Oct 13 04:09:11.237822 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 788 bytes} [Wed Oct 13 04:09:11 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:10:32.469541 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-b6a00027-eb3f-4651-9086-8aebc519ff72 None None] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:10:32.470821 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-b6a00027-eb3f-4651-9086-8aebc519ff72 None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Oct 13 04:10:32.471456 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 1/2] 10.222.0.55 () {54 vars in 930 bytes} [Wed Oct 13 04:10:32 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:10:32.899173 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-d57fa408-a5c9-454f-ac2f-b1a035e64e23 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:10:32.928462 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-d57fa408-a5c9-454f-ac2f-b1a035e64e23 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.449982 Oct 13 04:10:32.937774 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 2/3] 10.222.0.55 () {60 vars in 1291 bytes} [Wed Oct 13 04:10:32 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:10:35.190752 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-b6a00027-eb3f-4651-9086-8aebc519ff72 None None] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:10:35.191807 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-b6a00027-eb3f-4651-9086-8aebc519ff72 None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 13 04:10:35.192179 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 2/4] 10.222.0.55 () {54 vars in 930 bytes} [Wed Oct 13 04:10:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:10:35.252644 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-dff680d3-5bcd-4073-96cf-b941fb73c490 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "ram": 256}} {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:35.270756 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:10:35.270756 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: warnings.warn(msg) Oct 13 04:10:35.299815 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-dff680d3-5bcd-4073-96cf-b941fb73c490 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.100981 Oct 13 04:10:35.300572 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 3/5] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Oct 13 04:10:35 2021] POST /compute/v2.1/flavors => generated 407 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:10:35.524681 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-683d3e0c-9431-42a6-bee1-b2646aec9517 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:35.527078 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:10:35.527078 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: warnings.warn(msg) Oct 13 04:10:35.580051 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-683d3e0c-9431-42a6-bee1-b2646aec9517 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.270517 Oct 13 04:10:35.580848 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 3/6] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Oct 13 04:10:35 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:10:37.884339 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-dff680d3-5bcd-4073-96cf-b941fb73c490 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:10:37.885286 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-dff680d3-5bcd-4073-96cf-b941fb73c490 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Oct 13 04:10:37.886012 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 4/7] 10.222.0.55 () {54 vars in 930 bytes} [Wed Oct 13 04:10:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:10:38.005885 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-a56b158a-83cd-4e81-9988-ce1b176d3c79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "name": "ds512M"}} {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:38.023824 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:10:38.023824 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: warnings.warn(msg) Oct 13 04:10:38.044330 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-a56b158a-83cd-4e81-9988-ce1b176d3c79 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.151757 Oct 13 04:10:38.045114 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 4/8] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Oct 13 04:10:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:10:38.058790 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-a6c8e9c1-0490-4b92-a728-10bc9006a426 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:38.060477 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:10:38.060477 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: warnings.warn(msg) Oct 13 04:10:38.098673 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-a6c8e9c1-0490-4b92-a728-10bc9006a426 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044379 Oct 13 04:10:38.099655 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 5/9] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Oct 13 04:10:38 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:10:40.376039 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-a56b158a-83cd-4e81-9988-ce1b176d3c79 admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:10:40.377041 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-a56b158a-83cd-4e81-9988-ce1b176d3c79 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 13 04:10:40.377662 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 5/10] 10.222.0.55 () {54 vars in 930 bytes} [Wed Oct 13 04:10:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:10:40.439156 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-ac0003dd-5b82-4ff3-aa40-d3364dbb164e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1}} {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:40.459321 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-ac0003dd-5b82-4ff3-aa40-d3364dbb164e admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075056 Oct 13 04:10:40.461974 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 6/11] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Oct 13 04:10:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:10:40.472899 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-6284ad7a-648e-468e-9cd0-a602058f6df5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:40.495826 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-6284ad7a-648e-468e-9cd0-a602058f6df5 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027214 Oct 13 04:10:40.496532 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 6/12] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Oct 13 04:10:40 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:10:42.774167 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-ac0003dd-5b82-4ff3-aa40-d3364dbb164e admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:10:42.775303 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-ac0003dd-5b82-4ff3-aa40-d3364dbb164e admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Oct 13 04:10:42.775848 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 7/13] 10.222.0.55 () {54 vars in 930 bytes} [Wed Oct 13 04:10:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:10:42.834439 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-02d15ca9-df58-414f-95b7-577d2d2ac54e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "vcpus": 2}} {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:42.853217 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-02d15ca9-df58-414f-95b7-577d2d2ac54e admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070992 Oct 13 04:10:42.853780 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 7/14] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Oct 13 04:10:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:10:42.866403 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-8189aac1-cedc-4dd8-b169-ea70b89f16d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:42.890319 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-8189aac1-cedc-4dd8-b169-ea70b89f16d5 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027671 Oct 13 04:10:42.891012 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 8/15] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Oct 13 04:10:42 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:10:45.176086 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-02d15ca9-df58-414f-95b7-577d2d2ac54e admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:10:45.177100 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-02d15ca9-df58-414f-95b7-577d2d2ac54e admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 13 04:10:45.177466 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 8/16] 10.222.0.55 () {54 vars in 930 bytes} [Wed Oct 13 04:10:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:10:45.240269 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-d952ebc8-c2fc-4836-977b-b1dd3670599c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "disk": 20, "id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "ram": 4096, "rxtx_factor": 1.0, "swap": 0}} {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:45.259741 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-d952ebc8-c2fc-4836-977b-b1dd3670599c admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075620 Oct 13 04:10:45.260290 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 9/17] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Oct 13 04:10:45 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:10:45.272741 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-9f8b5917-05ea-41c2-b52d-01aa868b9296 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:45.296637 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-9f8b5917-05ea-41c2-b52d-01aa868b9296 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027587 Oct 13 04:10:45.309641 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 9/18] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Oct 13 04:10:45 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:10:47.629413 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-d952ebc8-c2fc-4836-977b-b1dd3670599c admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:10:47.630499 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-d952ebc8-c2fc-4836-977b-b1dd3670599c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Oct 13 04:10:47.630941 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 10/19] 10.222.0.55 () {54 vars in 930 bytes} [Wed Oct 13 04:10:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:10:47.698326 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-fec3a340-288a-4f66-9b58-653cb17e9c83 admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:10:47.722399 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-fec3a340-288a-4f66-9b58-653cb17e9c83 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084702 Oct 13 04:10:47.722910 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 10/20] 10.222.0.55 () {60 vars in 1291 bytes} [Wed Oct 13 04:10:47 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:10:50.717632 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-d952ebc8-c2fc-4836-977b-b1dd3670599c admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:10:50.718749 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-d952ebc8-c2fc-4836-977b-b1dd3670599c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001662 Oct 13 04:10:50.719174 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 11/21] 10.222.0.55 () {54 vars in 930 bytes} [Wed Oct 13 04:10:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:10:50.783818 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-b7a5ed31-5d69-4c85-9f60-4c1ae178eb85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "id": "1", "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1}} {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:50.807310 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-b7a5ed31-5d69-4c85-9f60-4c1ae178eb85 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081110 Oct 13 04:10:50.807999 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 11/22] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Oct 13 04:10:50 2021] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:10:50.821009 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-4c86c72c-71fe-4312-989e-cf4bd7a5643a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:50.844738 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-4c86c72c-71fe-4312-989e-cf4bd7a5643a admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027556 Oct 13 04:10:50.845648 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 12/23] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Oct 13 04:10:50 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:10:53.211333 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-b7a5ed31-5d69-4c85-9f60-4c1ae178eb85 admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:10:53.212349 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-b7a5ed31-5d69-4c85-9f60-4c1ae178eb85 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Oct 13 04:10:53.212734 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 12/24] 10.222.0.55 () {54 vars in 930 bytes} [Wed Oct 13 04:10:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:10:53.272369 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-be5727f4-ab89-4b12-b297-13727ec9efc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048}} {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:53.291779 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-be5727f4-ab89-4b12-b297-13727ec9efc0 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072821 Oct 13 04:10:53.292431 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 13/25] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Oct 13 04:10:53 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:10:53.304833 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-530ab47c-aad7-4b7a-a65f-b9e6d87861ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:53.327756 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-530ab47c-aad7-4b7a-a65f-b9e6d87861ba admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026681 Oct 13 04:10:53.328319 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 13/26] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Oct 13 04:10:53 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:10:55.604159 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-be5727f4-ab89-4b12-b297-13727ec9efc0 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:10:55.605195 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-be5727f4-ab89-4b12-b297-13727ec9efc0 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001682 Oct 13 04:10:55.605763 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 14/27] 10.222.0.55 () {54 vars in 930 bytes} [Wed Oct 13 04:10:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:10:55.667377 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-a7cff8a0-bbc9-4a1d-a1af-e35f728e3a77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "name": "m1.medium", "vcpus": 2, "id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:55.688180 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-a7cff8a0-bbc9-4a1d-a1af-e35f728e3a77 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075436 Oct 13 04:10:55.688701 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 14/28] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Oct 13 04:10:55 2021] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:10:55.702130 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-daed1dac-e001-4db7-b08c-3901a84fdda8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:55.726450 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-daed1dac-e001-4db7-b08c-3901a84fdda8 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028044 Oct 13 04:10:55.726992 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 15/29] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Oct 13 04:10:55 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:10:58.021370 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-a7cff8a0-bbc9-4a1d-a1af-e35f728e3a77 admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:10:58.022410 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-a7cff8a0-bbc9-4a1d-a1af-e35f728e3a77 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 13 04:10:58.022802 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 15/30] 10.222.0.55 () {54 vars in 930 bytes} [Wed Oct 13 04:10:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:10:58.090207 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-ffa2806e-da58-489e-b211-fc42849d4496 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "id": "4", "rxtx_factor": 1.0, "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:58.109137 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-ffa2806e-da58-489e-b211-fc42849d4496 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079582 Oct 13 04:10:58.117073 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 16/31] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Oct 13 04:10:58 2021] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:10:58.122596 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-b1e2907f-2a97-491a-bab6-c192954827ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:10:58.146023 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-b1e2907f-2a97-491a-bab6-c192954827ca admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027062 Oct 13 04:10:58.146605 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 16/32] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Oct 13 04:10:58 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:11:00.468913 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-ffa2806e-da58-489e-b211-fc42849d4496 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:00.469961 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-ffa2806e-da58-489e-b211-fc42849d4496 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 13 04:11:00.473730 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 17/33] 10.222.0.55 () {54 vars in 930 bytes} [Wed Oct 13 04:11:00 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:11:00.533394 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-b86bbbe2-0603-407d-92d8-3d5bfc690e37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "disk": 160, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5", "ram": 16384}} {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:11:00.558430 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-b86bbbe2-0603-407d-92d8-3d5bfc690e37 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.081384 Oct 13 04:11:00.559184 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 17/34] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Oct 13 04:11:00 2021] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:11:00.571578 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-d4ecad4c-1b94-46ec-bc0d-99aa3e41e803 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:11:00.596951 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-d4ecad4c-1b94-46ec-bc0d-99aa3e41e803 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029030 Oct 13 04:11:00.597653 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 18/35] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Oct 13 04:11:00 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:11:39.349597 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-b86bbbe2-0603-407d-92d8-3d5bfc690e37 admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:39.350634 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-b86bbbe2-0603-407d-92d8-3d5bfc690e37 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 13 04:11:39.351027 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 18/36] 10.222.0.55 () {54 vars in 930 bytes} [Wed Oct 13 04:11:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:11:39.427153 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-edfed132-2a78-44b6-b1e2-cb4c3773565c admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:39.443746 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-edfed132-2a78-44b6-b1e2-cb4c3773565c admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.085842 Oct 13 04:11:39.444239 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 19/37] 10.222.0.55 () {60 vars in 1291 bytes} [Wed Oct 13 04:11:39 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:11:40.953023 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-b86bbbe2-0603-407d-92d8-3d5bfc690e37 admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:40.954073 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-b86bbbe2-0603-407d-92d8-3d5bfc690e37 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 13 04:11:40.954473 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 19/38] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Oct 13 04:11:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:11:41.166180 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-5b6e9d37-8ea7-41e1-910e-067717dc2c2a admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:41.173107 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.wsgi [None req-5b6e9d37-8ea7-41e1-910e-067717dc2c2a admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 13 04:11:41.173723 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-5b6e9d37-8ea7-41e1-910e-067717dc2c2a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:11:41.174536 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-5b6e9d37-8ea7-41e1-910e-067717dc2c2a admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.082379 Oct 13 04:11:41.175060 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 20/39] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Oct 13 04:11:41 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 13 04:11:41.185300 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-55c84549-f632-4cf5-be73-fa413466c542 admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:41.207808 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-55c84549-f632-4cf5-be73-fa413466c542 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026139 Oct 13 04:11:41.208360 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 20/40] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Oct 13 04:11:41 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 04:11:41.219025 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-a9ad68ed-236b-49ff-9017-05084ec66d40 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:41.240249 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-a9ad68ed-236b-49ff-9017-05084ec66d40 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024863 Oct 13 04:11:41.240799 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 21/41] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Oct 13 04:11:41 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:11:41.250795 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-91a0329f-aae3-4ed2-ae1e-c28ca9d16d1b admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:41.256751 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.wsgi [None req-91a0329f-aae3-4ed2-ae1e-c28ca9d16d1b admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 13 04:11:41.257315 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-91a0329f-aae3-4ed2-ae1e-c28ca9d16d1b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:11:41.258143 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-91a0329f-aae3-4ed2-ae1e-c28ca9d16d1b admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010934 Oct 13 04:11:41.258624 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 21/42] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Oct 13 04:11:41 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 13 04:11:42.665012 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-a9ad68ed-236b-49ff-9017-05084ec66d40 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:42.666658 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-a9ad68ed-236b-49ff-9017-05084ec66d40 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002261 Oct 13 04:11:42.667315 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 22/43] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Oct 13 04:11:42 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:11:42.865665 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-63178cde-cb7b-4643-9af1-3a64fa492798 admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:42.871400 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.wsgi [None req-63178cde-cb7b-4643-9af1-3a64fa492798 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 13 04:11:42.871957 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-63178cde-cb7b-4643-9af1-3a64fa492798 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:11:42.872750 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-63178cde-cb7b-4643-9af1-3a64fa492798 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.069337 Oct 13 04:11:42.873270 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 22/44] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Oct 13 04:11:42 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 13 04:11:42.883353 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-98de4221-4138-40fc-9dbd-4dbdc6e0dec8 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:42.897048 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-98de4221-4138-40fc-9dbd-4dbdc6e0dec8 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017313 Oct 13 04:11:42.897578 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 23/45] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Oct 13 04:11:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:11:42.907360 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-2c19190c-fca2-46cc-8019-e14db35b8162 admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:42.922127 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-2c19190c-fca2-46cc-8019-e14db35b8162 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018191 Oct 13 04:11:42.922650 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 23/46] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Oct 13 04:11:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:11:42.932570 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-770ccf90-69ed-4218-bfd8-8e5a80d48ae0 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:42.937848 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.wsgi [None req-770ccf90-69ed-4218-bfd8-8e5a80d48ae0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 13 04:11:42.938413 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-770ccf90-69ed-4218-bfd8-8e5a80d48ae0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:11:42.939194 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-770ccf90-69ed-4218-bfd8-8e5a80d48ae0 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010150 Oct 13 04:11:42.939676 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 24/47] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Oct 13 04:11:42 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 13 04:11:44.337988 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-2c19190c-fca2-46cc-8019-e14db35b8162 admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:44.338987 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-2c19190c-fca2-46cc-8019-e14db35b8162 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 13 04:11:44.339386 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 24/48] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Oct 13 04:11:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:11:44.546208 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-65d67040-36c2-4188-a798-b392a2969491 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:44.552266 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.wsgi [None req-65d67040-36c2-4188-a798-b392a2969491 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 13 04:11:44.552841 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-65d67040-36c2-4188-a798-b392a2969491 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:11:44.553642 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-65d67040-36c2-4188-a798-b392a2969491 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.077739 Oct 13 04:11:44.554184 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 25/49] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Oct 13 04:11:44 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 13 04:11:44.564371 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-b01ad5ac-79a6-427a-930b-b976944d7688 admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:44.582932 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-b01ad5ac-79a6-427a-930b-b976944d7688 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022240 Oct 13 04:11:44.583471 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 25/50] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Oct 13 04:11:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:11:44.596497 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-74a41702-ee9e-4894-bdba-0dc2bd00ae73 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:44.615699 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-74a41702-ee9e-4894-bdba-0dc2bd00ae73 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025085 Oct 13 04:11:44.616222 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 26/51] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Oct 13 04:11:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:11:44.631418 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-2bf6cb5d-69f9-48b9-86ef-bef593a4a804 admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:44.639446 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.wsgi [None req-2bf6cb5d-69f9-48b9-86ef-bef593a4a804 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 13 04:11:44.640253 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-2bf6cb5d-69f9-48b9-86ef-bef593a4a804 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:11:44.641440 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-2bf6cb5d-69f9-48b9-86ef-bef593a4a804 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.015600 Oct 13 04:11:44.642139 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 26/52] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Oct 13 04:11:44 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 13 04:11:46.021805 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-74a41702-ee9e-4894-bdba-0dc2bd00ae73 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:46.022837 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-74a41702-ee9e-4894-bdba-0dc2bd00ae73 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001662 Oct 13 04:11:46.023240 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 27/53] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Oct 13 04:11:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:11:46.218433 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-5957078c-9609-409c-94d5-e5bbefd52f90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:11:46.238725 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-5957078c-9609-409c-94d5-e5bbefd52f90 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.078746 Oct 13 04:11:46.239153 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 27/54] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Oct 13 04:11:46 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:11:47.649637 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-74a41702-ee9e-4894-bdba-0dc2bd00ae73 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:47.650652 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-74a41702-ee9e-4894-bdba-0dc2bd00ae73 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 13 04:11:47.651047 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 28/55] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Oct 13 04:11:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:11:47.849302 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-951ce055-2064-41fb-b524-c2fee7555513 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:11:47.869192 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-951ce055-2064-41fb-b524-c2fee7555513 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.080276 Oct 13 04:11:47.869770 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 28/56] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Oct 13 04:11:47 2021] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:11:49.289766 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-74a41702-ee9e-4894-bdba-0dc2bd00ae73 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:49.290759 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-74a41702-ee9e-4894-bdba-0dc2bd00ae73 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 13 04:11:49.291154 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 29/57] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Oct 13 04:11:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:11:49.488748 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-8c6999dc-f494-487a-83c0-f401693a7595 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:11:49.509966 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-8c6999dc-f494-487a-83c0-f401693a7595 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.078907 Oct 13 04:11:49.510607 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 29/58] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Oct 13 04:11:49 2021] POST /compute/v2.1/flavors => generated 407 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:11:50.918515 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-74a41702-ee9e-4894-bdba-0dc2bd00ae73 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:50.919512 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-74a41702-ee9e-4894-bdba-0dc2bd00ae73 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 13 04:11:50.919916 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 30/59] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Oct 13 04:11:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:11:51.116284 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-8145a04c-1b5d-4afa-a8b5-150b7958988a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:11:51.136416 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-8145a04c-1b5d-4afa-a8b5-150b7958988a admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.078969 Oct 13 04:11:51.136888 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 30/60] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Oct 13 04:11:51 2021] POST /compute/v2.1/flavors => generated 409 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:11:52.524893 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-74a41702-ee9e-4894-bdba-0dc2bd00ae73 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:52.525963 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-74a41702-ee9e-4894-bdba-0dc2bd00ae73 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 13 04:11:52.526359 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 31/61] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Oct 13 04:11:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:11:52.734455 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-f1f31296-f9b9-4400-88a8-08e4c1c31a54 admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:11:52.753306 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-f1f31296-f9b9-4400-88a8-08e4c1c31a54 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.081777 Oct 13 04:11:52.754094 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 31/62] 10.222.0.55 () {60 vars in 1202 bytes} [Wed Oct 13 04:11:52 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:12:38.640570 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-74a41702-ee9e-4894-bdba-0dc2bd00ae73 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:12:38.641575 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-74a41702-ee9e-4894-bdba-0dc2bd00ae73 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 13 04:12:38.642003 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 32/63] 10.222.0.55 () {54 vars in 930 bytes} [Wed Oct 13 04:12:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:12:38.704394 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-4ac71a6d-15d1-49eb-8e94-ba9e52c2c7b1 admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:12:38.724362 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-4ac71a6d-15d1-49eb-8e94-ba9e52c2c7b1 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075434 Oct 13 04:12:38.724886 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 32/64] 10.222.0.55 () {60 vars in 1291 bytes} [Wed Oct 13 04:12:38 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:12:38.752442 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-2b044fd0-0b59-4478-9986-be1327cbd3de admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:12:38.760529 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-2b044fd0-0b59-4478-9986-be1327cbd3de admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011769 Oct 13 04:12:38.761057 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 33/65] 10.222.0.55 () {60 vars in 1282 bytes} [Wed Oct 13 04:12:38 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:12:38.773452 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-374e7b6a-a900-4035-a4a0-d42fbcad4b67 admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:12:38.781336 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-374e7b6a-a900-4035-a4a0-d42fbcad4b67 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011579 Oct 13 04:12:38.781867 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 33/66] 10.222.0.55 () {60 vars in 1285 bytes} [Wed Oct 13 04:12:38 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:12:38.794065 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-9552e2e3-287c-4df2-b06b-5cb073d6b96e admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:12:38.801890 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-9552e2e3-287c-4df2-b06b-5cb073d6b96e admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011104 Oct 13 04:12:38.802330 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 34/67] 10.222.0.55 () {60 vars in 1285 bytes} [Wed Oct 13 04:12:38 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:12:38.815560 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-65083ce3-add5-4a76-80be-76794473112e admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:12:38.823607 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-65083ce3-add5-4a76-80be-76794473112e admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011513 Oct 13 04:12:38.824121 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 34/68] 10.222.0.55 () {60 vars in 1282 bytes} [Wed Oct 13 04:12:38 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:14:03.572538 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-f37ee3ee-c687-4ec1-817b-98e20c086685 tempest-verify_tempest_config-1489379402 tempest-verify_tempest_config-1489379402-project] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:14:03.574514 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-f37ee3ee-c687-4ec1-817b-98e20c086685 tempest-verify_tempest_config-1489379402 tempest-verify_tempest_config-1489379402-project] 10.222.0.55 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107460 Oct 13 04:14:03.575256 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 35/69] 10.222.0.55 () {58 vars in 1133 bytes} [Wed Oct 13 04:14:03 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:15:30.692549 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-65083ce3-add5-4a76-80be-76794473112e admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:15:30.693848 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-65083ce3-add5-4a76-80be-76794473112e admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001932 Oct 13 04:15:30.694407 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 35/70] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Oct 13 04:15:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:15:30.972710 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-9c40d361-0c08-4514-811f-2857d00647e6 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:15:30.973895 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:15:30.973895 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: warnings.warn(msg) Oct 13 04:15:30.975402 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-9c40d361-0c08-4514-811f-2857d00647e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:15:30.975833 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-9c40d361-0c08-4514-811f-2857d00647e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:15:30.976603 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-9c40d361-0c08-4514-811f-2857d00647e6 admin admin] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:15:30.977021 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-9c40d361-0c08-4514-811f-2857d00647e6 admin admin] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:15:31.010100 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-9c40d361-0c08-4514-811f-2857d00647e6 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.175230 Oct 13 04:15:31.010662 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 36/71] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Oct 13 04:15:30 2021] GET /compute/v2.1/os-services => generated 791 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:15:32.443913 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-65083ce3-add5-4a76-80be-76794473112e admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:15:32.445182 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-65083ce3-add5-4a76-80be-76794473112e admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001753 Oct 13 04:15:32.445765 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 36/72] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Oct 13 04:15:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:15:32.652348 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-3c0ec3f9-21b4-436d-befa-288348220c73 admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:15:32.653508 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:15:32.653508 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: warnings.warn(msg) Oct 13 04:15:32.655071 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-3c0ec3f9-21b4-436d-befa-288348220c73 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:15:32.655514 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-3c0ec3f9-21b4-436d-befa-288348220c73 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:15:32.656295 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-3c0ec3f9-21b4-436d-befa-288348220c73 admin admin] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:15:32.656722 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-3c0ec3f9-21b4-436d-befa-288348220c73 admin admin] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:15:32.676551 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-3c0ec3f9-21b4-436d-befa-288348220c73 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.090928 Oct 13 04:15:32.677080 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 37/73] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Oct 13 04:15:32 2021] GET /compute/v2.1/os-services => generated 791 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:15:44.551373 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-65083ce3-add5-4a76-80be-76794473112e admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:15:44.552390 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-65083ce3-add5-4a76-80be-76794473112e admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 13 04:15:44.552783 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 37/74] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Oct 13 04:15:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:15:44.751177 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-5cc1f1ba-c4ed-47ae-946f-e95609b4abaf admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:15:44.752262 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:15:44.752262 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: warnings.warn(msg) Oct 13 04:15:44.753855 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-5cc1f1ba-c4ed-47ae-946f-e95609b4abaf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:15:44.754267 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-5cc1f1ba-c4ed-47ae-946f-e95609b4abaf admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:15:44.755038 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-5cc1f1ba-c4ed-47ae-946f-e95609b4abaf admin admin] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:15:44.755458 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-5cc1f1ba-c4ed-47ae-946f-e95609b4abaf admin admin] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:15:44.778983 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-5cc1f1ba-c4ed-47ae-946f-e95609b4abaf admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088243 Oct 13 04:15:44.779524 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 38/75] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Oct 13 04:15:44 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:15:46.182264 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: DEBUG nova.api.openstack.wsgi [None req-65083ce3-add5-4a76-80be-76794473112e admin admin] Calling method '>' {{(pid=93327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:15:46.183546 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: INFO nova.api.openstack.requestlog [None req-65083ce3-add5-4a76-80be-76794473112e admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001969 Oct 13 04:15:46.184074 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: [pid: 93327|app: 0|req: 38/76] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Oct 13 04:15:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:15:46.391341 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG nova.api.openstack.wsgi [None req-084001e1-3f2d-4c36-8362-138dc8bf26ba admin admin] Calling method '>' {{(pid=93328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:15:46.392490 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:15:46.392490 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: warnings.warn(msg) Oct 13 04:15:46.394014 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-084001e1-3f2d-4c36-8362-138dc8bf26ba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:15:46.394443 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-084001e1-3f2d-4c36-8362-138dc8bf26ba admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:15:46.395237 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-084001e1-3f2d-4c36-8362-138dc8bf26ba admin admin] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:15:46.395650 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: DEBUG oslo_concurrency.lockutils [None req-084001e1-3f2d-4c36-8362-138dc8bf26ba admin admin] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:15:46.416311 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: INFO nova.api.openstack.requestlog [None req-084001e1-3f2d-4c36-8362-138dc8bf26ba admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086160 Oct 13 04:15:46.416816 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: [pid: 93328|app: 0|req: 39/77] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Oct 13 04:15:46 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:16:42.365524 dv-cinder-812751-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 13 04:16:42.366082 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: Wed Oct 13 04:16:42 2021 - graceful shutdown triggered... Oct 13 04:16:42.366568 dv-cinder-812751-3-iscsi devstack@n-api.service[93327]: Gracefully killing worker 1 (pid: 93327)... Oct 13 04:16:42.367025 dv-cinder-812751-3-iscsi devstack@n-api.service[93328]: Gracefully killing worker 2 (pid: 93328)... Oct 13 04:16:43.367179 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: worker 1 buried after 1 seconds Oct 13 04:16:43.367179 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: worker 2 buried after 1 seconds Oct 13 04:16:43.367179 dv-cinder-812751-3-iscsi devstack@n-api.service[93326]: goodbye to uWSGI. Oct 13 04:16:43.369553 dv-cinder-812751-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 13 04:16:43.370564 dv-cinder-812751-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 13 04:16:43.374964 dv-cinder-812751-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 13 04:16:43.390295 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 13 04:16:43.394933 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 13 04:16:43 2021] *** Oct 13 04:16:43.394933 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 13 04:16:43.394933 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 13 04:16:43.394933 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: nodename: dv-cinder-812751-3-iscsi Oct 13 04:16:43.394933 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: machine: x86_64 Oct 13 04:16:43.394933 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: clock source: unix Oct 13 04:16:43.394933 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: pcre jit disabled Oct 13 04:16:43.394933 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: detected number of CPU cores: 4 Oct 13 04:16:43.394933 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: current working directory: / Oct 13 04:16:43.394933 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: detected binary path: /usr/bin/uwsgi-core Oct 13 04:16:43.394933 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: your processes number limit is 47680 Oct 13 04:16:43.394933 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: your memory page size is 4096 bytes Oct 13 04:16:43.394933 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: detected max file descriptor number: 2048 Oct 13 04:16:43.394933 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: lock engine: pthread robust mutexes Oct 13 04:16:43.396520 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: thunder lock: enabled Oct 13 04:16:43.396520 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 13 04:16:43.396520 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 13 04:16:43.442611 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: Python main interpreter initialized at 0x557cda6589c0 Oct 13 04:16:43.442611 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: python threads support enabled Oct 13 04:16:43.442611 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: your server socket listen backlog is limited to 100 connections Oct 13 04:16:43.442611 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: your mercy for graceful operations on workers is 90 seconds Oct 13 04:16:43.443067 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: mapped 403077 bytes (393 KB) for 2 cores Oct 13 04:16:43.443067 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: *** Operational MODE: preforking *** Oct 13 04:16:43.443320 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: *** uWSGI is running in multiple interpreter mode *** Oct 13 04:16:43.443320 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: spawned uWSGI master process (pid: 108248) Oct 13 04:16:43.443523 dv-cinder-812751-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 13 04:16:43.444213 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: spawned uWSGI worker 1 (pid: 108259, cores: 1) Oct 13 04:16:43.444752 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: spawned uWSGI worker 2 (pid: 108260, cores: 1) Oct 13 04:16:43.445068 dv-cinder-812751-3-iscsi devstack@n-api.service[108248]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 13 04:16:45.213210 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 04:16:45.213210 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: from cryptography.utils import int_from_bytes Oct 13 04:16:45.213989 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 04:16:45.213989 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: from cryptography.utils import int_from_bytes Oct 13 04:16:45.239760 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 04:16:45.239760 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: from cryptography.utils import int_from_bytes Oct 13 04:16:45.240445 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 04:16:45.240445 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: from cryptography.utils import int_from_bytes Oct 13 04:16:47.723563 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 04:16:47.724184 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 04:16:47.724267 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 04:16:47.724650 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 04:16:47.724884 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 04:16:47.725286 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.725655 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.725959 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.726273 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.726596 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.726885 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.727194 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.727541 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.727832 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.728089 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.728403 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.728726 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812751-3-iscsi {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.729087 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.729395 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.729731 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.730058 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.730359 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.730704 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.731000 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.731537 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.732918 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.732918 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.732918 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.733220 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.733467 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.733838 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.734120 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.734456 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.734746 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.735092 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.735458 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812751-3-iscsi {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.735773 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.736083 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.736392 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.736791 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.737102 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.737403 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.737733 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.738053 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.738368 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.738696 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.739013 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.739342 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.739644 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.739946 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.740249 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.740558 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.740874 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.741180 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.741482 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.741751 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.742073 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.742386 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.742687 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.743021 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.743268 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.743514 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.743836 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.744145 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.744454 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.744825 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.745124 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.745426 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.745749 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.746049 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.746347 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.746644 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.746958 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.747264 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.747582 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.747887 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.748199 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.748601 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.748912 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.749215 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.749479 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.749946 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.750148 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.750414 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.750721 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.751013 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.751355 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.751619 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.751919 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.752264 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.752563 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.752809 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.753104 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.753405 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.753750 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.754049 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.754352 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.754651 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.754944 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.755245 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.755544 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.755843 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.756140 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.756433 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.756716 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.757016 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.757315 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.757700 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.757948 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.758261 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.758561 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.758859 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.759160 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.759460 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.759769 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.760087 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.760404 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.760732 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.761015 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.761313 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.761637 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.761940 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.762273 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.762548 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.762840 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.763141 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.763459 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.763759 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.764056 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.764352 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.764664 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.764935 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.765232 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 04:16:47.765765 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.765910 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 04:16:47.766053 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.766053 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.766358 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 04:16:47.766511 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.766655 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 04:16:47.766797 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.766950 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 04:16:47.767105 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.767248 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.767396 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.767538 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.768266 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.768266 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.768461 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.768545 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.768619 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.768689 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.768759 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.768842 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.768925 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.769002 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.769072 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.769147 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.769384 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.769530 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.769829 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.770051 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.770390 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.770547 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.770734 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.770978 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.771214 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.771452 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812751-3-iscsi {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.771604 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.771861 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.772023 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.772187 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.772349 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.772591 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.772746 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.772892 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.773044 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.773193 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.773335 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.773476 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.773653 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.773824 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.773976 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.773976 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.774266 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.774434 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.774577 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.774732 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.774883 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.775034 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.775175 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.775317 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.775467 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.775625 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.775776 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.775989 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.776142 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.776142 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.776430 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.776580 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.776723 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.776864 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.777007 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.777148 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.777307 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.777307 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.777594 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812751-3-iscsi {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.777787 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.777948 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.777948 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.778238 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.778391 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.778545 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.778545 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.778829 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.778983 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.779142 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.779292 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.779450 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.779788 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.779961 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.780120 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.780272 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.780585 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.780740 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.780948 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.781198 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.781628 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.781793 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.782055 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.782213 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.782368 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.782522 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.782777 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.782926 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.783068 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.783211 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.783371 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.783514 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.783656 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.783797 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.783947 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.784088 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.784243 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.784387 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.784387 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.784666 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.784808 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.784957 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.785109 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.785251 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.785251 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.785529 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.785707 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.785853 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.785853 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.786151 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.786294 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.786448 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.786599 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.786756 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.786900 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.787042 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.787183 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.787331 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.787474 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.787626 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.787793 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.788025 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.788180 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.788334 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.788486 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.788630 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.788779 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.788929 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.789079 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.789223 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.789374 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.789516 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.789692 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.789973 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.790122 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.790771 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.790948 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.791100 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.791332 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.791489 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.791782 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.791927 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.792105 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.792333 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.792488 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.792631 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.792775 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.792917 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.793182 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.793332 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.793482 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.793645 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.793795 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.793956 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.794108 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.794259 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.794409 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.794559 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.794701 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.794917 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.795062 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.795225 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.795376 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.795525 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.795676 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.795829 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.795973 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.796115 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.796266 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.796423 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.796574 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.796717 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.796931 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.797084 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.797244 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.797395 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.797539 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.797830 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.797991 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.798135 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.798277 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.798418 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.798569 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.798721 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.798872 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.799024 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.799168 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.799332 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.799483 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.799639 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.799782 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.800067 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.800218 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.800361 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.800502 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.800847 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.801007 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.801159 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.801330 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.801552 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.801879 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.802049 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.802195 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.802356 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.802587 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.802742 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.802895 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.803047 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.803207 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.803444 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.803601 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.803755 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.803926 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.804069 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.804212 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.804354 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.804506 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.804657 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.804807 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.804958 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.805109 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.805266 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.805418 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.805563 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.805728 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.805882 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.806026 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.806185 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.806336 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.806490 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.806642 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.806793 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.806935 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.807086 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.807269 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.807269 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.807539 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.807680 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.807831 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.807831 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.808123 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.808272 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.808415 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.808558 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.808715 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.808866 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.809022 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.809022 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.809300 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.809442 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.809596 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.809838 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.809990 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.810289 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.810441 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.810600 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.810743 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.811057 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.811215 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.811366 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.811537 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.811760 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.812051 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.812197 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.812358 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.812503 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.812754 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.812916 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.813060 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.813211 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:16:47.813361 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.813600 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.813782 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.813935 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.814088 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.814088 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.814381 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.814527 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.814679 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.814832 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.814982 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.815127 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.815268 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.815409 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.815560 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.815704 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.815847 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.815997 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.816140 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.816299 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.816451 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.816605 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.816748 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.816890 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.817032 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.817184 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.817326 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.817467 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.817648 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.817806 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.817959 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.818193 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.818350 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.818494 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.818643 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.818792 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.818943 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.819096 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.819239 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.819388 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.819530 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.819672 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.819827 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.819984 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.820879 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.821194 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.821361 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.821506 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.821667 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.822301 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.822301 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.822611 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.822897 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.823055 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.823203 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.823406 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.823553 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.823819 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.823968 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.824118 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.824270 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.824421 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.824574 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.824724 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.824876 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.825019 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.825160 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.825303 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.825472 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.825668 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.825829 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.825981 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.826132 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.826275 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.826436 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.826579 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.826732 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.826732 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.827019 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.827162 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.827314 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.827475 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.827634 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.827777 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.827926 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.827926 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.828218 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.828369 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.828512 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.828661 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.828811 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.828811 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.829092 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.829233 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.829392 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.829537 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.829751 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.829912 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.830055 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.830055 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.830499 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.830649 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.830791 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.830946 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.831248 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.831416 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.831581 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.831739 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.831897 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.832047 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.832423 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.832590 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.832742 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.833129 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.833293 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.833446 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.833591 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.833758 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.834035 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.834180 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.834504 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.834657 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.834810 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.834954 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.835104 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.835199 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.835294 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.835387 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.835471 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.835561 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.835648 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.835735 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.835827 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.835917 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.836005 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.836094 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.836185 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.836277 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.836369 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.836452 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.836549 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.836549 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.836717 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.836882 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.836968 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.837050 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.837140 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.837224 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.837313 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.837395 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.837484 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.837574 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.837739 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.837828 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.837917 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.838002 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.838091 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.838181 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.838324 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.838421 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.838515 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.838607 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.838698 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.838782 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.838880 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.838964 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.839046 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.839127 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.839216 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.839216 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.839377 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.839459 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.839550 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.839550 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.839712 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.839808 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.839903 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.839987 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.840116 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.840216 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.840308 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.840421 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.840528 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.840623 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.840713 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.840797 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.840886 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.840979 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.841063 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.841151 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.841414 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.841519 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.841630 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.841728 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.841814 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.841902 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.841987 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.842068 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.842165 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.842256 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.842354 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.842633 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.842735 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.842828 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.842999 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.843086 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.843165 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.843244 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.843329 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.843419 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.843512 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.843602 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.843602 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.843752 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.843842 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.843938 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.844046 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.844127 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.844210 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.844312 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.844404 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.844499 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.844593 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.844677 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.844766 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.844855 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.844944 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.845037 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.845120 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.845208 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.845291 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.845373 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.845463 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.845555 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.845673 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.845770 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.845856 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.845945 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.846037 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.846120 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.846205 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.846293 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.846377 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.846466 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.846559 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.846642 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.846725 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.846806 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.846894 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.846977 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.847068 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.847150 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.847232 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.847455 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.847546 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.847767 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.847866 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.848069 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.848168 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.848370 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.848470 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.848672 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.848777 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.848969 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.849058 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.849269 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.849359 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.849572 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.849691 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.849892 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.849982 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.850191 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.850283 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.850508 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.850600 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.850811 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.850909 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.851110 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.851201 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.851421 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.851541 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.851717 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.851818 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.852021 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.852110 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.852335 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.852426 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.852676 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.852779 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.852946 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.853053 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.853253 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.853344 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.853559 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.853671 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.853998 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.854105 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.854308 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.854411 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.854611 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.854702 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.854911 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.855016 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.855222 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.855319 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.855528 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.855627 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.855838 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.855938 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.856138 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.856237 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.856440 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.856541 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.856755 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.856847 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.857059 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.857158 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.857363 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.857452 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.857717 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.857812 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.858017 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.858109 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.858338 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.858437 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.858640 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.858735 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.858944 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.859025 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.859247 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.859327 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.859553 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.859643 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.859858 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.859938 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.860161 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.860256 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.860467 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.860555 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.860782 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.860862 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.861088 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.861183 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.861396 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.861493 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.861749 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.861826 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.862012 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.862108 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.862315 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.862396 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.863973 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.864088 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.864172 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.864257 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.864330 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.864408 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.864487 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.864565 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.864671 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.864767 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.864852 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.864934 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.865015 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.865096 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.865186 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.865277 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.865367 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.865457 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.865547 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.866797 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.866911 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.866987 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.867056 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.867056 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.867187 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.867267 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.867368 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.867456 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.867538 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.867630 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.867721 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.867820 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.867820 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.867979 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.868062 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.868144 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.868434 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.868596 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.868736 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.868826 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.869045 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.869150 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.869349 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.869451 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.869744 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.869853 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.870056 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.870147 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.870364 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.870465 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.870664 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.870753 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.870965 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.871056 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.871265 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.871358 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.871566 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.871671 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.871874 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.871974 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.872172 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.872262 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.872478 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.872585 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.872816 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.872966 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.873209 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.873326 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.873424 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.873571 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.873750 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.873900 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.874066 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.874209 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.874371 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.874529 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.874694 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.874847 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.875005 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.875168 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.875308 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.875470 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.875614 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.875779 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.875917 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.876083 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.876262 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.876402 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.876567 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.876721 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.876905 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.877026 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.877235 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.877336 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.877575 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.877688 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.877905 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.877998 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.878211 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.878303 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.878538 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.878670 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.878851 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.879001 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.879157 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.879410 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.879508 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.879759 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.879864 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.880047 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.880148 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.880345 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.880443 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.880657 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.880748 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.880957 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.881052 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.881257 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.881355 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.881565 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.881706 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.881955 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.882057 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.882189 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.882280 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.882493 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.882589 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.882796 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.882902 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.883122 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.883219 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.883409 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.883512 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.883733 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.883823 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.884038 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.884164 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.884306 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.884443 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.884607 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.884728 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.884916 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.885029 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.885240 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.885343 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.885553 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.885764 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.885883 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.885972 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.886189 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.886291 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.886490 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.886581 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.886802 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.886898 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.887106 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.887206 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.887410 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.887522 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.887712 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.887813 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.888012 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.888111 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.888320 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.888418 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.888632 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.888738 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.888942 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.889052 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.889245 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.889352 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.889556 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.889686 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.889889 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.889979 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.890207 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.890304 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.890510 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.890600 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.890819 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.890917 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.891122 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.891212 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.891429 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.891528 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.891728 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.891817 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.892029 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.892130 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.892328 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.892426 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.892626 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.892715 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.892928 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.893016 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.893237 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.893403 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.893541 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.893659 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.893846 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.893946 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.894145 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.894256 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.894446 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.894546 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.894752 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.894857 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.895052 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.895167 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.895371 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.895471 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.895674 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.895772 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.895974 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.896073 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.896274 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.896380 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.896571 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.896670 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.896906 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.897012 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.897204 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.897308 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.897535 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.897664 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.897876 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.897981 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.898177 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.898267 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.898497 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.898595 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.898799 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.898888 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.899118 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.899208 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.899421 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.899518 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.899728 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.899818 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.900034 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.900122 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.900347 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.900445 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.900657 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.900752 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.901016 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.901108 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.901327 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.901429 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.901651 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.901758 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.901966 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.902085 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.902278 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.902377 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.902585 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.902674 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.902893 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.903134 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.903232 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.903491 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.903601 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.903762 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.903852 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.904072 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.904159 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.904384 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.904504 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.904690 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.904798 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.904998 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.905111 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.905305 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.905457 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.905600 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.905771 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.905920 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.906068 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.906224 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.906371 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.906518 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.906665 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.906828 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.906963 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.907135 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.907275 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.907447 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.907615 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.907754 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.907888 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.908037 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.908184 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.908331 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.908477 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.908654 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.908794 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.909007 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.909146 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.909317 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.909452 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.909684 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.909842 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.909988 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.910139 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.910287 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.910425 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.910562 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.910699 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.910844 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.910990 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.911127 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.911265 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.911411 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.911636 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.911775 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.911954 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.912088 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.912268 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.912359 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.912582 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.912731 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.912884 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.913015 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.913185 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.913344 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.913493 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.913632 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.913852 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.913951 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.914156 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.914254 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.914464 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.914565 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.914768 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.914868 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.915092 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.915636 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.915765 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.915948 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.916086 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.916278 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.916533 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.916628 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.916847 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.916946 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.917151 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.917243 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.917536 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.917648 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.917886 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.917980 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.918189 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.918282 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.918489 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.918589 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.918796 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.918896 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.919102 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.919200 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.919404 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.919495 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.919727 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.919819 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.920035 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.920126 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.920337 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.920440 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.920653 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.920744 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.920959 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.921056 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.921273 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.921489 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.921588 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.921869 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.921974 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.922185 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.922285 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.922514 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.922623 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.922837 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.922937 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.923155 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.923254 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.923460 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.923562 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.923788 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.923899 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.924084 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.924185 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.924387 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.924486 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.924699 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.924800 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.925005 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.925106 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.925309 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.925399 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.925629 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.925719 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.925940 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.926046 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.926248 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.926347 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.926548 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.926638 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.926855 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.926956 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.927157 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.927256 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.927475 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.927568 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.927777 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.927876 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.928080 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.928169 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.928381 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.928470 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.928687 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.928779 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.928987 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.929085 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.929289 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.929385 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.929591 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.929730 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.929911 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.930010 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.930220 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.930311 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.930519 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.930619 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.930825 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.930916 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.931126 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.931225 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.931431 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.931530 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.931731 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.931821 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.932057 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.932165 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.932416 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.932523 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.932740 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.932840 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.933044 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.933148 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.933344 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.933435 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.933695 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.933793 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.933991 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.934108 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.934311 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.934405 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.934624 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.934716 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.934932 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.935046 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.935262 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.935362 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.935569 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.935661 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.935876 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.936092 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.936191 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.936423 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.936523 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.936778 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.936882 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.937085 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.937186 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.937400 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.937500 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.937733 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.937842 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.938039 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.938140 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.938337 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.938428 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.938654 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.938754 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.938961 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.939053 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.939269 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.939360 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.939575 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.939668 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.939877 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.939966 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.940182 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.940287 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.940486 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.940578 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.940792 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.940884 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.941100 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.941205 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.941407 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.941499 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.941770 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.941862 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.942084 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.942224 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.942401 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.942510 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.942721 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.942818 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.943020 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.943123 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.943327 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.943427 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.943634 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.943733 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.943976 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.944137 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.944237 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.944322 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.944548 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.944648 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.944861 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.944960 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.945169 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.945268 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.945474 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.945566 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.945813 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.945915 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.946129 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.946261 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.946445 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.946538 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.946813 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.946962 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.947120 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.947290 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.947440 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.947602 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.947782 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.948091 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.948363 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.948473 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.948682 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.948784 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.948999 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.949100 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.949322 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.949414 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.949658 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.949842 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.949975 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.950069 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.950275 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.950376 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.950576 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.950669 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.950877 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.950982 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.951181 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.951280 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.951510 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.951603 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.951821 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.951911 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.952140 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.952242 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.952446 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.952539 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.952760 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.952857 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.953070 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.953174 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.953389 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.953489 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.953732 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.953838 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.954049 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.954154 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.954357 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.954449 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.954673 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.954773 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.954982 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.955083 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.955291 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.955384 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.955600 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.955692 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.955906 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.955998 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.956215 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.956402 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.956505 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.956599 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.956817 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.956914 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.957133 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.957233 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.957431 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.957532 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.957774 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.957881 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.958087 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.958187 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.958410 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.958545 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.958722 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.958825 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.959025 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.959133 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.959349 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.959465 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.959656 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.959866 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.959978 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.960182 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.960280 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.960516 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.960616 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.960844 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.960949 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.961154 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.961267 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.961477 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.961574 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.961819 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.962095 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.962184 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.962266 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.962439 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.962536 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.962745 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.962857 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.963062 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.963229 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.963426 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.963518 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.963738 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.963836 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.964094 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 04:16:47.964224 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.964372 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.964679 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.965002 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.965312 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.965882 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.966238 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.966560 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.966890 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.967220 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.967539 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.967850 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.968181 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.968490 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.968798 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.969117 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.969435 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.969766 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.970073 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.970387 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.970698 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.971005 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.971316 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.971624 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.971951 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.972257 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.972562 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.972868 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.973183 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.973488 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.973867 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.974144 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.974435 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.974748 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.975051 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.975362 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.975666 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.975979 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.976285 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.976594 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.976898 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.977223 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.977533 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.977864 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.978187 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.978499 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.978823 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.979173 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.979488 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.979834 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.980159 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.980690 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.981025 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.981398 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.981856 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.982295 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.982611 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.982923 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.983290 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.983560 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.983863 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.984177 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.984490 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.984803 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.985115 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.985438 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.985779 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.986091 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.986403 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.988829 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.988829 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.988829 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.988829 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.989258 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_db.sqlalchemy.engines [None req-1f0da86e-5801-4063-a394-3ba61f451cbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:16:47.989369 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.989369 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.989369 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.989369 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.989369 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.989795 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.989795 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.990105 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.990416 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.990852 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.991166 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.991488 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.991812 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.992125 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.992451 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.992777 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.993091 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.993419 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.993757 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.994102 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.994446 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.994834 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.995162 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.995454 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.995755 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.996059 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.996370 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.996703 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.997020 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.997344 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.997679 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.998005 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.998319 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.998652 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.998975 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.999306 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.999619 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:47.999955 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.000269 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.000584 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.000883 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.001189 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.001500 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.001837 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.002166 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.002492 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.002950 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.003548 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.003878 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.004203 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.004523 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.004838 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.005169 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.005484 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.005828 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.006141 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.006455 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.006773 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.007089 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.007416 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.007743 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.008069 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.008397 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.008747 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.009062 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.009416 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.009781 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:16:48.010027 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 04:16:48.032651 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_db.sqlalchemy.engines [None req-81b23aa4-a055-4b60-aa1d-58409d99e2b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:16:48.065849 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.context [None req-1f0da86e-5801-4063-a394-3ba61f451cbe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),44898ae1-31ba-46fa-a097-287ffc9bdaf3(cell1) {{(pid=108260) load_cells /opt/stack/nova/nova/context.py:464}} Oct 13 04:16:48.070294 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1f0da86e-5801-4063-a394-3ba61f451cbe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:16:48.071863 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1f0da86e-5801-4063-a394-3ba61f451cbe None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:16:48.072652 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1f0da86e-5801-4063-a394-3ba61f451cbe None None] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:16:48.074690 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1f0da86e-5801-4063-a394-3ba61f451cbe None None] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:16:48.085322 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_db.sqlalchemy.engines [None req-1f0da86e-5801-4063-a394-3ba61f451cbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:16:48.086858 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_db.sqlalchemy.engines [None req-1f0da86e-5801-4063-a394-3ba61f451cbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:16:48.111219 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.context [None req-81b23aa4-a055-4b60-aa1d-58409d99e2b4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),44898ae1-31ba-46fa-a097-287ffc9bdaf3(cell1) {{(pid=108259) load_cells /opt/stack/nova/nova/context.py:464}} Oct 13 04:16:48.115713 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-81b23aa4-a055-4b60-aa1d-58409d99e2b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:16:48.117312 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-81b23aa4-a055-4b60-aa1d-58409d99e2b4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:16:48.118136 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-81b23aa4-a055-4b60-aa1d-58409d99e2b4 None None] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:16:48.120111 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-81b23aa4-a055-4b60-aa1d-58409d99e2b4 None None] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:16:48.130791 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_db.sqlalchemy.engines [None req-81b23aa4-a055-4b60-aa1d-58409d99e2b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:16:48.132082 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_db.sqlalchemy.engines [None req-81b23aa4-a055-4b60-aa1d-58409d99e2b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:16:48.339678 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_db.sqlalchemy.engines [None req-1f0da86e-5801-4063-a394-3ba61f451cbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:16:48.395023 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_db.sqlalchemy.engines [None req-81b23aa4-a055-4b60-aa1d-58409d99e2b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:16:48.658360 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: WARNING keystonemiddleware.auth_token [None req-1f0da86e-5801-4063-a394-3ba61f451cbe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 04:16:48.664948 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: WARNING keystonemiddleware.auth_token [None req-1f0da86e-5801-4063-a394-3ba61f451cbe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 04:16:48.714624 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: WARNING keystonemiddleware.auth_token [None req-81b23aa4-a055-4b60-aa1d-58409d99e2b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 04:16:48.721397 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: WARNING keystonemiddleware.auth_token [None req-81b23aa4-a055-4b60-aa1d-58409d99e2b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 04:16:49.016656 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: WARNING keystonemiddleware.auth_token [None req-1f0da86e-5801-4063-a394-3ba61f451cbe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 04:16:49.022043 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: WARNING keystonemiddleware.auth_token [None req-1f0da86e-5801-4063-a394-3ba61f451cbe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 04:16:49.027252 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557cda6589c0 pid: 108260 (default app) Oct 13 04:16:49.069079 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: WARNING keystonemiddleware.auth_token [None req-81b23aa4-a055-4b60-aa1d-58409d99e2b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 04:16:49.074577 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: WARNING keystonemiddleware.auth_token [None req-81b23aa4-a055-4b60-aa1d-58409d99e2b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 04:16:49.079772 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557cda6589c0 pid: 108259 (default app) Oct 13 04:17:22.447221 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2059dada-2306-4f05-9aba-c7a75f1a2d8a tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] Action: 'create', calling method: .version_select at 0x7f33fcc74940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-37217991", "metadata": {"Type": "work"}}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:17:22.452834 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2059dada-2306-4f05-9aba-c7a75f1a2d8a tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:17:22.454329 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-2059dada-2306-4f05-9aba-c7a75f1a2d8a tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.350341 Oct 13 04:17:22.456098 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 1/1] 10.222.0.55 () {60 vars in 1155 bytes} [Wed Oct 13 04:17:21 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1354 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 04:17:22.471484 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b6e293ee-7b53-4a7d-b1b1-6243d2eebe42 tempest-VolumesGetTestJSON-2124010915 tempest-VolumesGetTestJSON-2124010915-project] Action: 'create', calling method: .version_select at 0x7f33fcc74940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-536962469", "metadata": {"Type": "work"}}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:17:22.532481 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2a90c332-d031-4315-99c1-0110b00a4da6 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-217094005", "imageRef": "4f468f34-171a-4b6e-a0cd-2e4c6fcda23d", "flavorRef": "452", "networks": [{"uuid": "1e6d939d-dbb2-4731-87b5-281d18075e13"}]}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:17:23.237444 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.network.neutron [None req-2a90c332-d031-4315-99c1-0110b00a4da6 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] validate_networks() for [('1e6d939d-dbb2-4731-87b5-281d18075e13', None, None, None, None, None)] {{(pid=108260) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:17:23.356519 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b6e293ee-7b53-4a7d-b1b1-6243d2eebe42 tempest-VolumesGetTestJSON-2124010915 tempest-VolumesGetTestJSON-2124010915-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.968961 Oct 13 04:17:23.358077 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 1/2] 10.222.0.55 () {60 vars in 1155 bytes} [Wed Oct 13 04:17:21 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 1974 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 13 04:17:23.366696 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5d8bf0de-8dba-4273-84a0-a6703c064b7a tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] Action: 'create', calling method: .version_select at 0x7f33fcbb8b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-193630270", "metadata": {"Type": "work"}}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:17:23.375565 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5d8bf0de-8dba-4273-84a0-a6703c064b7a tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:17:23.376395 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-5d8bf0de-8dba-4273-84a0-a6703c064b7a tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016126 Oct 13 04:17:23.378244 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 2/3] 10.222.0.55 () {60 vars in 1155 bytes} [Wed Oct 13 04:17:23 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 04:17:23.385671 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-074da0c5-86ef-4a47-bfde-2e155bf7f408 tempest-VolumesGetTestJSON-2124010915 tempest-VolumesGetTestJSON-2124010915-project] Calling method '.version_select at 0x7f33fd389430>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:23.471669 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-074da0c5-86ef-4a47-bfde-2e155bf7f408 tempest-VolumesGetTestJSON-2124010915 tempest-VolumesGetTestJSON-2124010915-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/ed8ef959-e834-493b-b9fd-905f5141a343" status: 200 len: 352 microversion: 2.1 time: 0.089503 Oct 13 04:17:23.473567 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 3/4] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Oct 13 04:17:23 2021] GET /compute/v2.1/os-volumes/ed8ef959-e834-493b-b9fd-905f5141a343 => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:17:23.478885 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7c658c0e-1e5b-4277-833f-4bb854e926ef tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] Action: 'create', calling method: .version_select at 0x7f33fca09040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-189996166", "metadata": {"Type": "work"}}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:17:23.480509 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7c658c0e-1e5b-4277-833f-4bb854e926ef tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:17:23.482165 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7c658c0e-1e5b-4277-833f-4bb854e926ef tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007445 Oct 13 04:17:23.483357 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 4/5] 10.222.0.55 () {60 vars in 1155 bytes} [Wed Oct 13 04:17:23 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 04:17:23.492266 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c6c9bf63-d05d-4e87-8971-350bb9f772ff tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] Calling method '.version_select at 0x7f33fca13040>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:23.530873 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-c6c9bf63-d05d-4e87-8971-350bb9f772ff tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] HTTP exception thrown: Volume tempest-invalid-1848491162 could not be found. Oct 13 04:17:23.531819 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c6c9bf63-d05d-4e87-8971-350bb9f772ff tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] Returning 404 to user: Volume tempest-invalid-1848491162 could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:17:23.532863 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c6c9bf63-d05d-4e87-8971-350bb9f772ff tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1848491162" status: 404 len: 99 microversion: 2.1 time: 0.044652 Oct 13 04:17:23.533545 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 5/6] 10.222.0.55 () {58 vars in 1217 bytes} [Wed Oct 13 04:17:23 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1848491162 => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 13 04:17:23.543029 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7da68003-4891-4117-bb53-c40415658c55 tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004179 Oct 13 04:17:23.544063 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 6/7] 10.222.0.55 () {58 vars in 1139 bytes} [Wed Oct 13 04:17:23 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 13 04:17:23.559146 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f0a46ac4-54a9-4a41-8c2b-762ff22bb586 tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009516 Oct 13 04:17:23.560174 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 7/8] 10.222.0.55 () {58 vars in 1136 bytes} [Wed Oct 13 04:17:23 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 13 04:17:23.570798 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-63f22efc-ff54-427f-b0f8-0736573545f1 tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] Calling method '.version_select at 0x7f33fca099d0>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:23.602701 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-63f22efc-ff54-427f-b0f8-0736573545f1 tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] HTTP exception thrown: Volume b7d9a768-6b7f-4534-8263-073bbe73ca33 could not be found. Oct 13 04:17:23.603675 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-63f22efc-ff54-427f-b0f8-0736573545f1 tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] Returning 404 to user: Volume b7d9a768-6b7f-4534-8263-073bbe73ca33 could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:17:23.604675 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-63f22efc-ff54-427f-b0f8-0736573545f1 tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/b7d9a768-6b7f-4534-8263-073bbe73ca33" status: 404 len: 109 microversion: 2.1 time: 0.037555 Oct 13 04:17:23.605250 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 8/9] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Oct 13 04:17:23 2021] DELETE /compute/v2.1/os-volumes/b7d9a768-6b7f-4534-8263-073bbe73ca33 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:17:23.617387 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-695c5c5e-e20a-4c54-a4e3-8a48469f3f1f tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] Calling method '.version_select at 0x7f33fca09040>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:23.654891 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-695c5c5e-e20a-4c54-a4e3-8a48469f3f1f tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] HTTP exception thrown: Volume 244bbf50-5cbd-460a-bc48-db73e122f857 could not be found. Oct 13 04:17:23.656313 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-695c5c5e-e20a-4c54-a4e3-8a48469f3f1f tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] Returning 404 to user: Volume 244bbf50-5cbd-460a-bc48-db73e122f857 could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:17:23.658461 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-695c5c5e-e20a-4c54-a4e3-8a48469f3f1f tempest-VolumesNegativeTest-1028548698 tempest-VolumesNegativeTest-1028548698-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/244bbf50-5cbd-460a-bc48-db73e122f857" status: 404 len: 109 microversion: 2.1 time: 0.045629 Oct 13 04:17:23.659764 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 9/10] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Oct 13 04:17:23 2021] GET /compute/v2.1/os-volumes/244bbf50-5cbd-460a-bc48-db73e122f857 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 04:17:24.337950 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-fb2bccc2-e825-49d6-830a-1c1aae4e2f89 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1666901234", "imageRef": "4f468f34-171a-4b6e-a0cd-2e4c6fcda23d", "flavorRef": "452", "networks": [{"uuid": "0d1ab067-7575-4c07-97ac-3bce9cca9c59"}]}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:17:24.466702 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.network.neutron [None req-fb2bccc2-e825-49d6-830a-1c1aae4e2f89 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] validate_networks() for [('0d1ab067-7575-4c07-97ac-3bce9cca9c59', None, None, None, None, None)] {{(pid=108259) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:17:25.025564 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-2a90c332-d031-4315-99c1-0110b00a4da6 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Flavor limits 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:17:25.026751 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-2a90c332-d031-4315-99c1-0110b00a4da6 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Image limits 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:17:25.027608 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-2a90c332-d031-4315-99c1-0110b00a4da6 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Flavor pref 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:17:25.028249 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-2a90c332-d031-4315-99c1-0110b00a4da6 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Image pref 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:17:25.028879 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-2a90c332-d031-4315-99c1-0110b00a4da6 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:17:25.048987 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2a90c332-d031-4315-99c1-0110b00a4da6 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:25.049432 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2a90c332-d031-4315-99c1-0110b00a4da6 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:25.050254 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2a90c332-d031-4315-99c1-0110b00a4da6 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:25.050668 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2a90c332-d031-4315-99c1-0110b00a4da6 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:25.084723 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-2a90c332-d031-4315-99c1-0110b00a4da6 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Getting quotas for project 4d531b9d4b7c47ca9168806481e36699. Resources: {'ram', 'cores', 'instances'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:17:25.095135 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-2a90c332-d031-4315-99c1-0110b00a4da6 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Getting quotas for user 1aabc6e5e816429cb88496a128d5b9eb and project 4d531b9d4b7c47ca9168806481e36699. Resources: {'ram', 'cores', 'instances'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:17:25.125304 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-2a90c332-d031-4315-99c1-0110b00a4da6 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Going to run 1 instances... {{(pid=108260) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:17:25.129965 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-2a90c332-d031-4315-99c1-0110b00a4da6 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f468f34-171a-4b6e-a0cd-2e4c6fcda23d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:17:25.230227 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-2a90c332-d031-4315-99c1-0110b00a4da6 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.772533 Oct 13 04:17:25.234035 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 2/11] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Oct 13 04:17:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 2777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 04:17:25.240791 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9d5e3688-acd5-438c-b2be-ee6583330bdf tempest-VolumesGetTestJSON-2124010915 tempest-VolumesGetTestJSON-2124010915-project] Calling method '.version_select at 0x7f33fc9a7940>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:25.370627 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9d5e3688-acd5-438c-b2be-ee6583330bdf tempest-VolumesGetTestJSON-2124010915 tempest-VolumesGetTestJSON-2124010915-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/ed8ef959-e834-493b-b9fd-905f5141a343" status: 200 len: 353 microversion: 2.1 time: 0.134771 Oct 13 04:17:25.371348 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 3/12] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Oct 13 04:17:25 2021] GET /compute/v2.1/os-volumes/ed8ef959-e834-493b-b9fd-905f5141a343 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:17:25.376390 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d2907956-f0f0-4e67-aa29-d3d35651d1ac tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] Calling method '.version_select at 0x7f33fc9be700>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:25.450413 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d2907956-f0f0-4e67-aa29-d3d35651d1ac tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/e05ea550-805d-4b0e-8ac6-7a5a9a70835a" status: 200 len: 351 microversion: 2.1 time: 0.077710 Oct 13 04:17:25.451009 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 4/13] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Oct 13 04:17:25 2021] GET /compute/v2.1/os-volumes/e05ea550-805d-4b0e-8ac6-7a5a9a70835a => generated 351 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:17:25.455697 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-61d353b4-8669-4e3e-bb82-92c5c7850af2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:25.456303 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-61d353b4-8669-4e3e-bb82-92c5c7850af2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:25.499393 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-fb2bccc2-e825-49d6-830a-1c1aae4e2f89 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Flavor limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:17:25.500551 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-fb2bccc2-e825-49d6-830a-1c1aae4e2f89 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Image limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:17:25.501372 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-fb2bccc2-e825-49d6-830a-1c1aae4e2f89 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Flavor pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:17:25.502109 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-fb2bccc2-e825-49d6-830a-1c1aae4e2f89 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Image pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:17:25.502834 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-fb2bccc2-e825-49d6-830a-1c1aae4e2f89 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:17:25.541942 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fb2bccc2-e825-49d6-830a-1c1aae4e2f89 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:25.542717 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fb2bccc2-e825-49d6-830a-1c1aae4e2f89 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:25.549808 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fb2bccc2-e825-49d6-830a-1c1aae4e2f89 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:25.550521 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fb2bccc2-e825-49d6-830a-1c1aae4e2f89 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:25.633334 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-fb2bccc2-e825-49d6-830a-1c1aae4e2f89 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Getting quotas for project f6806325e2e94089a6944698ad9b7808. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:17:25.651335 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-fb2bccc2-e825-49d6-830a-1c1aae4e2f89 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Getting quotas for user 9d3f110a789d432d85e185decef26aea and project f6806325e2e94089a6944698ad9b7808. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:17:25.653006 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-61d353b4-8669-4e3e-bb82-92c5c7850af2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:25.677499 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-61d353b4-8669-4e3e-bb82-92c5c7850af2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1214 microversion: 2.1 time: 0.224674 Oct 13 04:17:25.698217 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 5/14] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:25 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1214 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:25.719486 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-fb2bccc2-e825-49d6-830a-1c1aae4e2f89 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Going to run 1 instances... {{(pid=108259) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:17:25.721749 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6a20932d-6f2e-46bc-af1a-6697f60d8a58 tempest-VolumesGetTestJSON-2124010915 tempest-VolumesGetTestJSON-2124010915-project] Calling method '.version_select at 0x7f33fc137280>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:25.722255 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-fb2bccc2-e825-49d6-830a-1c1aae4e2f89 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f468f34-171a-4b6e-a0cd-2e4c6fcda23d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:17:25.819813 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6a20932d-6f2e-46bc-af1a-6697f60d8a58 tempest-VolumesGetTestJSON-2124010915 tempest-VolumesGetTestJSON-2124010915-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/ed8ef959-e834-493b-b9fd-905f5141a343" status: 200 len: 353 microversion: 2.1 time: 0.138288 Oct 13 04:17:25.820614 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 6/15] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Oct 13 04:17:25 2021] GET /compute/v2.1/os-volumes/ed8ef959-e834-493b-b9fd-905f5141a343 => generated 353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:17:25.840100 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d7569739-47f4-4b03-ae08-8c8e2a27c199 tempest-VolumesGetTestJSON-2124010915 tempest-VolumesGetTestJSON-2124010915-project] Calling method '.version_select at 0x7f33fc0c3160>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:25.912723 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-fb2bccc2-e825-49d6-830a-1c1aae4e2f89 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.765375 Oct 13 04:17:25.929643 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 10/16] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Oct 13 04:17:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 04:17:25.936293 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a0f6646a-f3d9-4d6c-ad75-4f56411291d7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:25.936907 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a0f6646a-f3d9-4d6c-ad75-4f56411291d7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:25.961593 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d7569739-47f4-4b03-ae08-8c8e2a27c199 tempest-VolumesGetTestJSON-2124010915 tempest-VolumesGetTestJSON-2124010915-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/ed8ef959-e834-493b-b9fd-905f5141a343" status: 202 len: 0 microversion: 2.1 time: 0.125248 Oct 13 04:17:25.967590 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 7/17] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Oct 13 04:17:25 2021] DELETE /compute/v2.1/os-volumes/ed8ef959-e834-493b-b9fd-905f5141a343 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:17:25.974709 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-0de8f21b-5b09-4e0a-92fa-dde76eb416c7 tempest-VolumesGetTestJSON-2124010915 tempest-VolumesGetTestJSON-2124010915-project] Calling method '.version_select at 0x7f33fc12ce50>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:26.071152 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-0de8f21b-5b09-4e0a-92fa-dde76eb416c7 tempest-VolumesGetTestJSON-2124010915 tempest-VolumesGetTestJSON-2124010915-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/ed8ef959-e834-493b-b9fd-905f5141a343" status: 200 len: 352 microversion: 2.1 time: 0.102046 Oct 13 04:17:26.077667 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 8/18] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Oct 13 04:17:25 2021] GET /compute/v2.1/os-volumes/ed8ef959-e834-493b-b9fd-905f5141a343 => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:17:26.122843 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a0f6646a-f3d9-4d6c-ad75-4f56411291d7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:26.141268 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a0f6646a-f3d9-4d6c-ad75-4f56411291d7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1218 microversion: 2.1 time: 0.209594 Oct 13 04:17:26.141888 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 11/19] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:25 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1218 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:26.699967 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-19d09c24-f4ae-4565-86c2-cd8234d23358 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:26.700902 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-19d09c24-f4ae-4565-86c2-cd8234d23358 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:26.833454 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-19d09c24-f4ae-4565-86c2-cd8234d23358 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:26.845102 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-19d09c24-f4ae-4565-86c2-cd8234d23358 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1214 microversion: 2.1 time: 0.151106 Oct 13 04:17:26.866651 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 9/20] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:26 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:27.085079 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4c4575cb-5d17-417d-bda1-1c1c5ca437f1 tempest-VolumesGetTestJSON-2124010915 tempest-VolumesGetTestJSON-2124010915-project] Calling method '.version_select at 0x7f33fc12dca0>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:27.158986 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-694b08ab-afbb-4cac-947f-a5b62f021c07 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:27.160310 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-694b08ab-afbb-4cac-947f-a5b62f021c07 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:27.185871 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-4c4575cb-5d17-417d-bda1-1c1c5ca437f1 tempest-VolumesGetTestJSON-2124010915 tempest-VolumesGetTestJSON-2124010915-project] HTTP exception thrown: Volume ed8ef959-e834-493b-b9fd-905f5141a343 could not be found. Oct 13 04:17:27.186480 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4c4575cb-5d17-417d-bda1-1c1c5ca437f1 tempest-VolumesGetTestJSON-2124010915 tempest-VolumesGetTestJSON-2124010915-project] Returning 404 to user: Volume ed8ef959-e834-493b-b9fd-905f5141a343 could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:17:27.187739 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4c4575cb-5d17-417d-bda1-1c1c5ca437f1 tempest-VolumesGetTestJSON-2124010915 tempest-VolumesGetTestJSON-2124010915-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/ed8ef959-e834-493b-b9fd-905f5141a343" status: 404 len: 109 microversion: 2.1 time: 0.106852 Oct 13 04:17:27.187858 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 12/21] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Oct 13 04:17:27 2021] GET /compute/v2.1/os-volumes/ed8ef959-e834-493b-b9fd-905f5141a343 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:17:27.418343 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-6a16d722-2933-4d7d-ab32-0755ef94f738 tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] Calling method '.version_select at 0x7f33fc13ba60>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:27.607230 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-6a16d722-2933-4d7d-ab32-0755ef94f738 tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/89f856e6-0515-4ef2-96a4-ad954b05d72d" status: 200 len: 350 microversion: 2.1 time: 0.194038 Oct 13 04:17:27.608005 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 13/22] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Oct 13 04:17:27 2021] GET /compute/v2.1/os-volumes/89f856e6-0515-4ef2-96a4-ad954b05d72d => generated 350 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:17:27.687958 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-694b08ab-afbb-4cac-947f-a5b62f021c07 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:27.705017 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-694b08ab-afbb-4cac-947f-a5b62f021c07 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1218 microversion: 2.1 time: 0.550009 Oct 13 04:17:27.718537 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 10/23] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:27 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1218 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:27.871165 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-fb91f94b-564e-47dc-bf8e-a0095dafefb4 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:27.871974 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-fb91f94b-564e-47dc-bf8e-a0095dafefb4 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:27.886234 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fb91f94b-564e-47dc-bf8e-a0095dafefb4 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:27.886958 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fb91f94b-564e-47dc-bf8e-a0095dafefb4 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:27.888004 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fb91f94b-564e-47dc-bf8e-a0095dafefb4 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:27.889666 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fb91f94b-564e-47dc-bf8e-a0095dafefb4 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:28.436126 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-fb91f94b-564e-47dc-bf8e-a0095dafefb4 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:28.474251 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-fb91f94b-564e-47dc-bf8e-a0095dafefb4 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1210 microversion: 2.1 time: 0.592996 Oct 13 04:17:28.475051 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 14/24] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:27 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1210 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:28.740235 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5faa2f43-8c6e-46a4-9d69-22f28ea4acb0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:28.742110 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5faa2f43-8c6e-46a4-9d69-22f28ea4acb0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:28.762997 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5faa2f43-8c6e-46a4-9d69-22f28ea4acb0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:28.763455 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5faa2f43-8c6e-46a4-9d69-22f28ea4acb0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:28.764407 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5faa2f43-8c6e-46a4-9d69-22f28ea4acb0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:28.764663 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5faa2f43-8c6e-46a4-9d69-22f28ea4acb0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:29.415800 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-28fa27bd-31c7-4cec-8e25-39b937547ef7 tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] Calling method '.version_select at 0x7f33fc0bc700>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:29.477499 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5faa2f43-8c6e-46a4-9d69-22f28ea4acb0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:29.502139 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5faa2f43-8c6e-46a4-9d69-22f28ea4acb0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1214 microversion: 2.1 time: 0.770912 Oct 13 04:17:29.505281 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 11/25] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:28 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1214 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:29.533488 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b7a6dbc0-9f93-42a9-876d-6f52a064f3b9 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:29.535199 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b7a6dbc0-9f93-42a9-876d-6f52a064f3b9 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:29.570254 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b7a6dbc0-9f93-42a9-876d-6f52a064f3b9 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:29.598416 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b7a6dbc0-9f93-42a9-876d-6f52a064f3b9 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:29.599539 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b7a6dbc0-9f93-42a9-876d-6f52a064f3b9 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:29.603255 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-28fa27bd-31c7-4cec-8e25-39b937547ef7 tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/ae5f4005-88e9-474f-b051-2afe22b19e75" status: 200 len: 350 microversion: 2.1 time: 0.191457 Oct 13 04:17:29.604953 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 15/26] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Oct 13 04:17:29 2021] GET /compute/v2.1/os-volumes/ae5f4005-88e9-474f-b051-2afe22b19e75 => generated 350 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:17:29.606420 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b7a6dbc0-9f93-42a9-876d-6f52a064f3b9 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:29.615776 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-02c1e55a-dcf0-4d3e-8e33-8ea9968fcb30 tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] Calling method '.version_select at 0x7f33fc0444c0>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:29.976171 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-02c1e55a-dcf0-4d3e-8e33-8ea9968fcb30 tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.363960 Oct 13 04:17:29.976938 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 16/27] 10.222.0.55 () {58 vars in 1133 bytes} [Wed Oct 13 04:17:29 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:17:29.991183 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-09429c11-1b53-40fd-a2e3-567bbc093383 tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] Calling method '.version_select at 0x7f33fc044940>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:30.186826 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-09429c11-1b53-40fd-a2e3-567bbc093383 tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.200284 Oct 13 04:17:30.187711 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 17/28] 10.222.0.55 () {58 vars in 1148 bytes} [Wed Oct 13 04:17:29 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:17:30.228757 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-be67cef2-60b9-4f07-953e-cd3ca7ba70fa tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] Calling method '.version_select at 0x7f33fc0bcaf0>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:30.242393 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b7a6dbc0-9f93-42a9-876d-6f52a064f3b9 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:30.277756 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b7a6dbc0-9f93-42a9-876d-6f52a064f3b9 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1272 microversion: 2.1 time: 0.760565 Oct 13 04:17:30.278313 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 12/29] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:29 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1272 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:30.429296 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-be67cef2-60b9-4f07-953e-cd3ca7ba70fa tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.231598 Oct 13 04:17:30.430502 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 18/30] 10.222.0.55 () {58 vars in 1133 bytes} [Wed Oct 13 04:17:30 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:30.442388 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f17a0298-3277-4a89-9608-30a44afa3e5f tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] Calling method '.version_select at 0x7f33fc0491f0>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:30.519993 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-072cf07b-cedd-4ee7-8ba1-678cc147b4f8 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:30.520604 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-072cf07b-cedd-4ee7-8ba1-678cc147b4f8 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:30.531274 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-072cf07b-cedd-4ee7-8ba1-678cc147b4f8 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:30.535150 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-072cf07b-cedd-4ee7-8ba1-678cc147b4f8 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:30.535990 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-072cf07b-cedd-4ee7-8ba1-678cc147b4f8 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:30.536441 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-072cf07b-cedd-4ee7-8ba1-678cc147b4f8 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:30.705175 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f17a0298-3277-4a89-9608-30a44afa3e5f tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.267245 Oct 13 04:17:30.705859 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 13/31] 10.222.0.55 () {58 vars in 1166 bytes} [Wed Oct 13 04:17:30 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:17:30.717602 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-79d5ca14-8c1c-4a08-9711-02f3e6ad6792 tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] Calling method '.version_select at 0x7f33fc0171f0>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:30.936044 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-072cf07b-cedd-4ee7-8ba1-678cc147b4f8 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:30.949245 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-072cf07b-cedd-4ee7-8ba1-678cc147b4f8 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1276 microversion: 2.1 time: 0.428488 Oct 13 04:17:30.962686 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 19/32] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:30 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1276 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:31.300586 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f95f04bf-0b77-49ee-847e-ce5c6fbfb5ed tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:31.304290 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f95f04bf-0b77-49ee-847e-ce5c6fbfb5ed tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:31.314674 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f95f04bf-0b77-49ee-847e-ce5c6fbfb5ed tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:31.315184 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f95f04bf-0b77-49ee-847e-ce5c6fbfb5ed tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:31.320655 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f95f04bf-0b77-49ee-847e-ce5c6fbfb5ed tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:31.321111 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f95f04bf-0b77-49ee-847e-ce5c6fbfb5ed tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:31.560091 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-79d5ca14-8c1c-4a08-9711-02f3e6ad6792 tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.844732 Oct 13 04:17:31.563429 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 14/33] 10.222.0.55 () {58 vars in 1169 bytes} [Wed Oct 13 04:17:30 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:17:31.576469 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a9fd0d40-cfda-42b9-938c-04866c977183 tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] Calling method '.version_select at 0x7f33fc017a60>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:31.745293 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f95f04bf-0b77-49ee-847e-ce5c6fbfb5ed tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:31.757368 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f95f04bf-0b77-49ee-847e-ce5c6fbfb5ed tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1272 microversion: 2.1 time: 0.460757 Oct 13 04:17:31.777100 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 20/34] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:31 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1272 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:17:31.851792 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a9fd0d40-cfda-42b9-938c-04866c977183 tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.280397 Oct 13 04:17:31.852480 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 15/35] 10.222.0.55 () {58 vars in 1154 bytes} [Wed Oct 13 04:17:31 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:17:31.865324 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-17b9c7f4-03eb-47a2-85ee-2885b625dbc1 tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] Calling method '.version_select at 0x7f33fc076550>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:31.966360 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-84810760-de7e-4712-84c6-a54270ae7b12 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:31.966979 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-84810760-de7e-4712-84c6-a54270ae7b12 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:31.979978 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84810760-de7e-4712-84c6-a54270ae7b12 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:31.980471 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84810760-de7e-4712-84c6-a54270ae7b12 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:31.994059 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84810760-de7e-4712-84c6-a54270ae7b12 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:31.994520 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84810760-de7e-4712-84c6-a54270ae7b12 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:32.148196 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-17b9c7f4-03eb-47a2-85ee-2885b625dbc1 tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.287488 Oct 13 04:17:32.148936 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 21/36] 10.222.0.55 () {58 vars in 1187 bytes} [Wed Oct 13 04:17:31 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:17:32.170295 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-08764795-b77e-4447-9759-49ec037ce85b tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] Calling method '.version_select at 0x7f33fc01e5e0>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:32.237544 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-84810760-de7e-4712-84c6-a54270ae7b12 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:32.250671 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-84810760-de7e-4712-84c6-a54270ae7b12 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1276 microversion: 2.1 time: 0.287789 Oct 13 04:17:32.252000 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 16/37] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:31 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1276 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:32.420373 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-08764795-b77e-4447-9759-49ec037ce85b tempest-VolumesTestJSON-1407605466 tempest-VolumesTestJSON-1407605466-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.262058 Oct 13 04:17:32.420947 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 22/38] 10.222.0.55 () {58 vars in 1154 bytes} [Wed Oct 13 04:17:32 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:17:32.779398 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-28879d61-3ee6-4980-895c-13796488b4cf tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:32.779967 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-28879d61-3ee6-4980-895c-13796488b4cf tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:32.795346 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-28879d61-3ee6-4980-895c-13796488b4cf tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:32.795806 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-28879d61-3ee6-4980-895c-13796488b4cf tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:32.796644 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-28879d61-3ee6-4980-895c-13796488b4cf tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:32.797704 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-28879d61-3ee6-4980-895c-13796488b4cf tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:33.267758 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ad17d847-00c1-4cfe-87fe-8f05331a1a5c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:33.268682 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ad17d847-00c1-4cfe-87fe-8f05331a1a5c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:33.285327 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ad17d847-00c1-4cfe-87fe-8f05331a1a5c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:33.295950 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ad17d847-00c1-4cfe-87fe-8f05331a1a5c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:33.297114 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ad17d847-00c1-4cfe-87fe-8f05331a1a5c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:33.299191 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ad17d847-00c1-4cfe-87fe-8f05331a1a5c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:33.812253 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ad17d847-00c1-4cfe-87fe-8f05331a1a5c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:33.822199 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ad17d847-00c1-4cfe-87fe-8f05331a1a5c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1276 microversion: 2.1 time: 0.557910 Oct 13 04:17:33.825726 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 23/39] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:33 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1276 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:34.571136 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-28879d61-3ee6-4980-895c-13796488b4cf tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:34.587505 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-28879d61-3ee6-4980-895c-13796488b4cf tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 1.809511 Oct 13 04:17:34.617240 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 17/40] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:32 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:34.840282 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1ef43269-0086-4b03-8681-42070202baf2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:34.844168 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1ef43269-0086-4b03-8681-42070202baf2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:34.876861 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1ef43269-0086-4b03-8681-42070202baf2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:34.877309 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1ef43269-0086-4b03-8681-42070202baf2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:34.887339 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1ef43269-0086-4b03-8681-42070202baf2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:34.887844 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1ef43269-0086-4b03-8681-42070202baf2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:35.493428 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1ef43269-0086-4b03-8681-42070202baf2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:35.509691 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1ef43269-0086-4b03-8681-42070202baf2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1276 microversion: 2.1 time: 0.664613 Oct 13 04:17:35.509691 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 24/41] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:34 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1276 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:35.625846 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-580749c4-8516-4c2d-9c61-f55525bb825f tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:35.626438 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-580749c4-8516-4c2d-9c61-f55525bb825f tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:35.636350 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-580749c4-8516-4c2d-9c61-f55525bb825f tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:35.636905 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-580749c4-8516-4c2d-9c61-f55525bb825f tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:35.659743 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-580749c4-8516-4c2d-9c61-f55525bb825f tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:35.660262 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-580749c4-8516-4c2d-9c61-f55525bb825f tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:36.170144 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-580749c4-8516-4c2d-9c61-f55525bb825f tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:36.193062 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-580749c4-8516-4c2d-9c61-f55525bb825f tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.570702 Oct 13 04:17:36.193716 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 18/42] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:35 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:36.524013 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-06e51fce-6f46-4bd8-9b5d-0f925f978b9f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:36.524702 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-06e51fce-6f46-4bd8-9b5d-0f925f978b9f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:36.542310 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4dc9cc5e-c724-48d8-acaf-0885b630ba1e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'create', calling method: .version_select at 0x7f33fc0d4940>, body: {"keypair": {"name": "tempest-keypair-266153083"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:17:36.545674 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-06e51fce-6f46-4bd8-9b5d-0f925f978b9f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:36.546294 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-06e51fce-6f46-4bd8-9b5d-0f925f978b9f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:36.547203 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-06e51fce-6f46-4bd8-9b5d-0f925f978b9f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:36.550304 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-06e51fce-6f46-4bd8-9b5d-0f925f978b9f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:36.610498 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-4dc9cc5e-c724-48d8-acaf-0885b630ba1e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Getting quotas for project f2312bd342e040f1ade7109084831451. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:17:36.632506 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-4dc9cc5e-c724-48d8-acaf-0885b630ba1e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Getting quotas for user 9c76000ef3ee4d9eabd8de600a39badb and project f2312bd342e040f1ade7109084831451. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:17:37.030703 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-06e51fce-6f46-4bd8-9b5d-0f925f978b9f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:37.042257 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-06e51fce-6f46-4bd8-9b5d-0f925f978b9f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.519408 Oct 13 04:17:37.046770 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 19/43] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:36 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:17:37.171257 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-4dc9cc5e-c724-48d8-acaf-0885b630ba1e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Getting quotas for project f2312bd342e040f1ade7109084831451. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:17:37.175282 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-4dc9cc5e-c724-48d8-acaf-0885b630ba1e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Getting quotas for user 9c76000ef3ee4d9eabd8de600a39badb and project f2312bd342e040f1ade7109084831451. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:17:37.190853 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4dc9cc5e-c724-48d8-acaf-0885b630ba1e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.238606 Oct 13 04:17:37.192111 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 25/44] 10.222.0.55 () {60 vars in 1157 bytes} [Wed Oct 13 04:17:35 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:37.215384 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8343ba6d-a025-4d77-b375-7f0f306bdf8c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:37.218369 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-8343ba6d-a025-4d77-b375-7f0f306bdf8c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:37.232844 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8343ba6d-a025-4d77-b375-7f0f306bdf8c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:37.233653 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8343ba6d-a025-4d77-b375-7f0f306bdf8c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:37.235702 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8343ba6d-a025-4d77-b375-7f0f306bdf8c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:37.238374 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8343ba6d-a025-4d77-b375-7f0f306bdf8c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:37.430260 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7a86e8fa-139f-4320-9d69-e01873b91247 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'create', calling method: .version_select at 0x7f33fc137d30>, body: {"keypair": {"name": "tempest-keypair-975720806"}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:17:37.487793 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-7a86e8fa-139f-4320-9d69-e01873b91247 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Getting quotas for project d168ef71e112452db0a5035cfc0e4b2b. Resources: {'key_pairs'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:17:37.499173 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-7a86e8fa-139f-4320-9d69-e01873b91247 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Getting quotas for user 6353e635051e487cb5ae8f73097aab5e and project d168ef71e112452db0a5035cfc0e4b2b. Resources: {'key_pairs'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:17:37.510544 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-8343ba6d-a025-4d77-b375-7f0f306bdf8c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:37.518846 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-8343ba6d-a025-4d77-b375-7f0f306bdf8c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.312296 Oct 13 04:17:37.522366 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 26/45] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:37 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:38.062515 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-79a0d459-5174-4ba0-9549-800b5e456cf9 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:38.063288 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-79a0d459-5174-4ba0-9549-800b5e456cf9 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:38.070997 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-79a0d459-5174-4ba0-9549-800b5e456cf9 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:38.074160 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-79a0d459-5174-4ba0-9549-800b5e456cf9 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:38.075144 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-79a0d459-5174-4ba0-9549-800b5e456cf9 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:38.076889 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-79a0d459-5174-4ba0-9549-800b5e456cf9 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:38.083949 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-7a86e8fa-139f-4320-9d69-e01873b91247 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Getting quotas for project d168ef71e112452db0a5035cfc0e4b2b. Resources: {'key_pairs'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:17:38.093107 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-7a86e8fa-139f-4320-9d69-e01873b91247 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Getting quotas for user 6353e635051e487cb5ae8f73097aab5e and project d168ef71e112452db0a5035cfc0e4b2b. Resources: {'key_pairs'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:17:38.121309 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7a86e8fa-139f-4320-9d69-e01873b91247 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.952920 Oct 13 04:17:38.122583 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 20/46] 10.222.0.55 () {62 vars in 1198 bytes} [Wed Oct 13 04:17:37 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 955 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 13 04:17:38.285397 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-79a0d459-5174-4ba0-9549-800b5e456cf9 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:38.297505 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-79a0d459-5174-4ba0-9549-800b5e456cf9 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.238474 Oct 13 04:17:38.298642 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 27/47] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:38 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:38.541364 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3370b788-85f5-4dbb-8109-df5464235104 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:38.542176 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3370b788-85f5-4dbb-8109-df5464235104 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:38.555275 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3370b788-85f5-4dbb-8109-df5464235104 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:38.557225 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3370b788-85f5-4dbb-8109-df5464235104 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:38.558881 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3370b788-85f5-4dbb-8109-df5464235104 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:38.565401 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3370b788-85f5-4dbb-8109-df5464235104 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:38.858315 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-3370b788-85f5-4dbb-8109-df5464235104 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:38.876002 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3370b788-85f5-4dbb-8109-df5464235104 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.340852 Oct 13 04:17:38.876603 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 21/48] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:38 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:39.317070 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3a17f517-18e7-4408-92b1-54e444b1e0fb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:39.318039 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3a17f517-18e7-4408-92b1-54e444b1e0fb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:39.329462 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3a17f517-18e7-4408-92b1-54e444b1e0fb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:39.330010 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3a17f517-18e7-4408-92b1-54e444b1e0fb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:39.332075 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3a17f517-18e7-4408-92b1-54e444b1e0fb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:39.334116 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3a17f517-18e7-4408-92b1-54e444b1e0fb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:39.734012 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-3a17f517-18e7-4408-92b1-54e444b1e0fb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:39.746161 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3a17f517-18e7-4408-92b1-54e444b1e0fb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.434608 Oct 13 04:17:39.757772 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 28/49] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:39 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:39.894752 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-85b2a42d-2f5c-497b-9568-65eadf7b4aa2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:39.895533 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-85b2a42d-2f5c-497b-9568-65eadf7b4aa2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:39.918187 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-85b2a42d-2f5c-497b-9568-65eadf7b4aa2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:39.921646 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-85b2a42d-2f5c-497b-9568-65eadf7b4aa2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:39.935870 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-85b2a42d-2f5c-497b-9568-65eadf7b4aa2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:39.936461 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-85b2a42d-2f5c-497b-9568-65eadf7b4aa2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:40.160606 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7a4133d4-6944-4a00-8d47-4bd9388a634d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1525218208", "imageRef": "4f468f34-171a-4b6e-a0cd-2e4c6fcda23d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58ed8cef-059d-4c9e-a8e2-6045b8f93ca6"}], "security_groups": [{"name": "tempest-securitygroup--1577274337"}], "key_name": "tempest-keypair-266153083", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:17:40.430823 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-85b2a42d-2f5c-497b-9568-65eadf7b4aa2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:40.442791 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.network.neutron [None req-7a4133d4-6944-4a00-8d47-4bd9388a634d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] validate_networks() for [('58ed8cef-059d-4c9e-a8e2-6045b8f93ca6', None, None, None, None, None)] {{(pid=108259) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:17:40.446111 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-85b2a42d-2f5c-497b-9568-65eadf7b4aa2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.554575 Oct 13 04:17:40.454873 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 22/50] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:39 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:40.763363 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-49534f39-130f-435b-8d2f-33824c9edd1f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:40.763975 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-49534f39-130f-435b-8d2f-33824c9edd1f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:40.770836 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49534f39-130f-435b-8d2f-33824c9edd1f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:40.771281 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49534f39-130f-435b-8d2f-33824c9edd1f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:40.772211 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49534f39-130f-435b-8d2f-33824c9edd1f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:40.772780 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49534f39-130f-435b-8d2f-33824c9edd1f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:41.064678 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-49534f39-130f-435b-8d2f-33824c9edd1f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:41.088464 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-49534f39-130f-435b-8d2f-33824c9edd1f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.314203 Oct 13 04:17:41.092588 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 23/51] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:40 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:17:41.461937 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-fa6cfbd7-d499-47e4-86a8-ed012ada74c9 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:41.462552 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-fa6cfbd7-d499-47e4-86a8-ed012ada74c9 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:41.468927 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fa6cfbd7-d499-47e4-86a8-ed012ada74c9 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:41.482340 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fa6cfbd7-d499-47e4-86a8-ed012ada74c9 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:41.483181 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fa6cfbd7-d499-47e4-86a8-ed012ada74c9 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:41.483613 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fa6cfbd7-d499-47e4-86a8-ed012ada74c9 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:41.593257 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-7a4133d4-6944-4a00-8d47-4bd9388a634d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Flavor limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:17:41.594501 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-7a4133d4-6944-4a00-8d47-4bd9388a634d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Image limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:17:41.595271 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-7a4133d4-6944-4a00-8d47-4bd9388a634d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Flavor pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:17:41.595874 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-7a4133d4-6944-4a00-8d47-4bd9388a634d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Image pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:17:41.596619 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-7a4133d4-6944-4a00-8d47-4bd9388a634d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:17:41.606006 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7a4133d4-6944-4a00-8d47-4bd9388a634d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:41.608142 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7a4133d4-6944-4a00-8d47-4bd9388a634d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:41.609954 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7a4133d4-6944-4a00-8d47-4bd9388a634d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:41.611696 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7a4133d4-6944-4a00-8d47-4bd9388a634d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:41.652552 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-7a4133d4-6944-4a00-8d47-4bd9388a634d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Getting quotas for project f2312bd342e040f1ade7109084831451. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:17:41.656949 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-7a4133d4-6944-4a00-8d47-4bd9388a634d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Getting quotas for user 9c76000ef3ee4d9eabd8de600a39badb and project f2312bd342e040f1ade7109084831451. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:17:41.669373 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7a4133d4-6944-4a00-8d47-4bd9388a634d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Going to run 1 instances... {{(pid=108259) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:17:41.672043 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7a4133d4-6944-4a00-8d47-4bd9388a634d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f468f34-171a-4b6e-a0cd-2e4c6fcda23d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:17:41.752135 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-fa6cfbd7-d499-47e4-86a8-ed012ada74c9 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:41.754897 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7a4133d4-6944-4a00-8d47-4bd9388a634d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.598641 Oct 13 04:17:41.756973 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 29/52] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Oct 13 04:17:40 2021] POST /compute/v2.1/servers => generated 402 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 04:17:41.769275 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0bc62af0-f163-4117-a67f-53bf8576d2a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:41.769645 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0bc62af0-f163-4117-a67f-53bf8576d2a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:41.775787 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-fa6cfbd7-d499-47e4-86a8-ed012ada74c9 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.317355 Oct 13 04:17:41.776293 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 24/53] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:41 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:17:41.932048 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-0bc62af0-f163-4117-a67f-53bf8576d2a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:41.940261 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0bc62af0-f163-4117-a67f-53bf8576d2a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1237 microversion: 2.1 time: 0.175799 Oct 13 04:17:41.950477 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 30/54] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:41 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1237 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:42.107564 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-bfb57bee-71c6-4e19-9c0b-dc8d40492713 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:42.108027 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-bfb57bee-71c6-4e19-9c0b-dc8d40492713 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:42.117027 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bfb57bee-71c6-4e19-9c0b-dc8d40492713 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:42.120043 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bfb57bee-71c6-4e19-9c0b-dc8d40492713 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:42.120986 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bfb57bee-71c6-4e19-9c0b-dc8d40492713 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:42.122789 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bfb57bee-71c6-4e19-9c0b-dc8d40492713 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:42.373320 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-bfb57bee-71c6-4e19-9c0b-dc8d40492713 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:42.385342 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-bfb57bee-71c6-4e19-9c0b-dc8d40492713 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.280034 Oct 13 04:17:42.387779 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 25/55] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:42 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:42.628773 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-87704199-bddf-4019-90dc-a5c0fc305a33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-496493248", "imageRef": "4f468f34-171a-4b6e-a0cd-2e4c6fcda23d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c4537c4-626c-4872-8f08-761847ce7780"}], "security_groups": [{"name": "tempest-securitygroup--1340049926"}], "key_name": "tempest-keypair-975720806", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:17:42.736050 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.network.neutron [None req-87704199-bddf-4019-90dc-a5c0fc305a33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] validate_networks() for [('1c4537c4-626c-4872-8f08-761847ce7780', None, None, None, None, None)] {{(pid=108259) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:17:42.793711 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-fdbabb0e-dfad-440a-a10d-4e7b8cba1e66 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:42.794262 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-fdbabb0e-dfad-440a-a10d-4e7b8cba1e66 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:42.800242 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fdbabb0e-dfad-440a-a10d-4e7b8cba1e66 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:42.800987 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fdbabb0e-dfad-440a-a10d-4e7b8cba1e66 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:42.801773 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fdbabb0e-dfad-440a-a10d-4e7b8cba1e66 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:42.802382 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fdbabb0e-dfad-440a-a10d-4e7b8cba1e66 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:43.095654 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-fdbabb0e-dfad-440a-a10d-4e7b8cba1e66 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:43.111246 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-fdbabb0e-dfad-440a-a10d-4e7b8cba1e66 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.321323 Oct 13 04:17:43.115073 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 26/56] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:42 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:43.132780 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d9b7e086-774a-47d5-ac5f-42f0eb063181 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:43.137652 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d9b7e086-774a-47d5-ac5f-42f0eb063181 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:43.151747 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d9b7e086-774a-47d5-ac5f-42f0eb063181 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:43.152594 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d9b7e086-774a-47d5-ac5f-42f0eb063181 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:43.155232 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d9b7e086-774a-47d5-ac5f-42f0eb063181 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:43.157596 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d9b7e086-774a-47d5-ac5f-42f0eb063181 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:43.332367 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d9b7e086-774a-47d5-ac5f-42f0eb063181 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:43.340737 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d9b7e086-774a-47d5-ac5f-42f0eb063181 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1241 microversion: 2.1 time: 0.215233 Oct 13 04:17:43.345218 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 27/57] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:43 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1241 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:43.406837 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-fc507be8-b764-4823-a00e-e26793089fd5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:43.409016 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-fc507be8-b764-4823-a00e-e26793089fd5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:43.416997 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fc507be8-b764-4823-a00e-e26793089fd5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:43.417828 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fc507be8-b764-4823-a00e-e26793089fd5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:43.418912 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fc507be8-b764-4823-a00e-e26793089fd5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:43.419663 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fc507be8-b764-4823-a00e-e26793089fd5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:43.615146 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-87704199-bddf-4019-90dc-a5c0fc305a33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Flavor limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:17:43.615561 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-87704199-bddf-4019-90dc-a5c0fc305a33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Image limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:17:43.616960 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-87704199-bddf-4019-90dc-a5c0fc305a33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Flavor pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:17:43.617533 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-87704199-bddf-4019-90dc-a5c0fc305a33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Image pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:17:43.618317 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-87704199-bddf-4019-90dc-a5c0fc305a33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:17:43.642158 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-87704199-bddf-4019-90dc-a5c0fc305a33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:43.642845 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-87704199-bddf-4019-90dc-a5c0fc305a33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:43.646110 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-87704199-bddf-4019-90dc-a5c0fc305a33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:43.647354 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-87704199-bddf-4019-90dc-a5c0fc305a33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:43.684780 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-87704199-bddf-4019-90dc-a5c0fc305a33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Getting quotas for project d168ef71e112452db0a5035cfc0e4b2b. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:17:43.691075 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-87704199-bddf-4019-90dc-a5c0fc305a33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Getting quotas for user 6353e635051e487cb5ae8f73097aab5e and project d168ef71e112452db0a5035cfc0e4b2b. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:17:43.702205 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-fc507be8-b764-4823-a00e-e26793089fd5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:43.713734 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-87704199-bddf-4019-90dc-a5c0fc305a33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Going to run 1 instances... {{(pid=108259) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:17:43.716555 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-87704199-bddf-4019-90dc-a5c0fc305a33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f468f34-171a-4b6e-a0cd-2e4c6fcda23d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:17:43.741514 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-fc507be8-b764-4823-a00e-e26793089fd5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.341822 Oct 13 04:17:43.742198 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 28/58] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:43 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:43.810704 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-87704199-bddf-4019-90dc-a5c0fc305a33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.185664 Oct 13 04:17:43.811672 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 31/59] 10.222.0.55 () {62 vars in 1187 bytes} [Wed Oct 13 04:17:42 2021] POST /compute/v2.1/servers => generated 402 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 04:17:43.821296 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-079ea42e-1d16-46a6-8329-dce5a968bdcf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:43.821973 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-079ea42e-1d16-46a6-8329-dce5a968bdcf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:43.899351 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-079ea42e-1d16-46a6-8329-dce5a968bdcf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:43.906546 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-079ea42e-1d16-46a6-8329-dce5a968bdcf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:43.908063 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-079ea42e-1d16-46a6-8329-dce5a968bdcf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:43.909230 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-079ea42e-1d16-46a6-8329-dce5a968bdcf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1280 microversion: 2.20 time: 0.091681 Oct 13 04:17:43.909741 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 29/60] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:17:43 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1280 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:17:44.131477 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-671477b2-50cf-4c24-971f-3f98ee118cda tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:44.132751 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-671477b2-50cf-4c24-971f-3f98ee118cda tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:44.140460 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-671477b2-50cf-4c24-971f-3f98ee118cda tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:44.141467 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-671477b2-50cf-4c24-971f-3f98ee118cda tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:44.147046 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-671477b2-50cf-4c24-971f-3f98ee118cda tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:44.147755 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-671477b2-50cf-4c24-971f-3f98ee118cda tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:44.316640 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-671477b2-50cf-4c24-971f-3f98ee118cda tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:44.328593 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-671477b2-50cf-4c24-971f-3f98ee118cda tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.200898 Oct 13 04:17:44.340143 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 32/61] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:44 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:44.364136 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-8836eacb-7521-4051-a302-5402a85f91de tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:44.366052 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-8836eacb-7521-4051-a302-5402a85f91de tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:44.375398 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8836eacb-7521-4051-a302-5402a85f91de tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:44.376370 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8836eacb-7521-4051-a302-5402a85f91de tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:44.377669 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8836eacb-7521-4051-a302-5402a85f91de tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:44.390546 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8836eacb-7521-4051-a302-5402a85f91de tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:44.482533 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-8836eacb-7521-4051-a302-5402a85f91de tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:44.500731 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-8836eacb-7521-4051-a302-5402a85f91de tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1241 microversion: 2.1 time: 0.141578 Oct 13 04:17:44.501750 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 30/62] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:44 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1241 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:44.758892 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e66bd820-770b-4a04-a410-9f494c7968c5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:44.759498 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e66bd820-770b-4a04-a410-9f494c7968c5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:44.767663 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e66bd820-770b-4a04-a410-9f494c7968c5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:44.768283 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e66bd820-770b-4a04-a410-9f494c7968c5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:44.769433 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e66bd820-770b-4a04-a410-9f494c7968c5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:44.770289 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e66bd820-770b-4a04-a410-9f494c7968c5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:44.928984 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-76b7df14-4b69-4df3-a69b-22e7108d5170 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:44.930125 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-76b7df14-4b69-4df3-a69b-22e7108d5170 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:44.957492 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-76b7df14-4b69-4df3-a69b-22e7108d5170 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:44.960111 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-76b7df14-4b69-4df3-a69b-22e7108d5170 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:44.961411 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-76b7df14-4b69-4df3-a69b-22e7108d5170 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:44.964046 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-76b7df14-4b69-4df3-a69b-22e7108d5170 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:45.100772 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-76b7df14-4b69-4df3-a69b-22e7108d5170 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:45.112161 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-76b7df14-4b69-4df3-a69b-22e7108d5170 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:45.113993 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-76b7df14-4b69-4df3-a69b-22e7108d5170 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:45.115581 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-76b7df14-4b69-4df3-a69b-22e7108d5170 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1284 microversion: 2.20 time: 0.191146 Oct 13 04:17:45.118181 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 31/63] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:17:44 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1284 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 04:17:45.173578 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-e66bd820-770b-4a04-a410-9f494c7968c5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:45.183143 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e66bd820-770b-4a04-a410-9f494c7968c5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.427763 Oct 13 04:17:45.184640 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 33/64] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:44 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:45.347482 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-49538780-dff1-47ce-a047-7fd9a0d09117 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:45.348104 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-49538780-dff1-47ce-a047-7fd9a0d09117 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:45.357936 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49538780-dff1-47ce-a047-7fd9a0d09117 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:45.358747 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49538780-dff1-47ce-a047-7fd9a0d09117 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:45.360226 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49538780-dff1-47ce-a047-7fd9a0d09117 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:45.360943 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49538780-dff1-47ce-a047-7fd9a0d09117 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:45.520234 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2f194967-a3fb-4208-aed1-85a5dd457239 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:45.520977 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2f194967-a3fb-4208-aed1-85a5dd457239 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:45.530027 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2f194967-a3fb-4208-aed1-85a5dd457239 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:45.530577 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2f194967-a3fb-4208-aed1-85a5dd457239 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:45.531450 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2f194967-a3fb-4208-aed1-85a5dd457239 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:45.532525 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2f194967-a3fb-4208-aed1-85a5dd457239 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:45.541170 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-49538780-dff1-47ce-a047-7fd9a0d09117 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:45.549063 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-49538780-dff1-47ce-a047-7fd9a0d09117 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.205325 Oct 13 04:17:45.550013 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 32/65] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:45 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:45.616416 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2f194967-a3fb-4208-aed1-85a5dd457239 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:45.623854 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2f194967-a3fb-4208-aed1-85a5dd457239 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1241 microversion: 2.1 time: 0.107558 Oct 13 04:17:45.624391 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 34/66] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:45 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:17:46.135170 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ca440f9f-5edb-4dbb-83cc-4a991a6b6703 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:46.136068 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ca440f9f-5edb-4dbb-83cc-4a991a6b6703 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:46.157737 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ca440f9f-5edb-4dbb-83cc-4a991a6b6703 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:46.158199 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ca440f9f-5edb-4dbb-83cc-4a991a6b6703 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:46.158974 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ca440f9f-5edb-4dbb-83cc-4a991a6b6703 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:46.159392 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ca440f9f-5edb-4dbb-83cc-4a991a6b6703 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:46.200084 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ff383668-5095-448e-9065-ea8817616002 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:46.200743 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ff383668-5095-448e-9065-ea8817616002 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:46.206969 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ff383668-5095-448e-9065-ea8817616002 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:46.207406 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ff383668-5095-448e-9065-ea8817616002 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:46.208168 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ff383668-5095-448e-9065-ea8817616002 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:46.208584 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ff383668-5095-448e-9065-ea8817616002 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:46.232201 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-ca440f9f-5edb-4dbb-83cc-4a991a6b6703 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:46.240127 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-ca440f9f-5edb-4dbb-83cc-4a991a6b6703 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:46.241800 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-ca440f9f-5edb-4dbb-83cc-4a991a6b6703 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:46.243138 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ca440f9f-5edb-4dbb-83cc-4a991a6b6703 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1284 microversion: 2.20 time: 0.112352 Oct 13 04:17:46.244196 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 33/67] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:17:46 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:17:46.335488 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ff383668-5095-448e-9065-ea8817616002 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:46.342609 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ff383668-5095-448e-9065-ea8817616002 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.146141 Oct 13 04:17:46.343178 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 35/68] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:46 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:17:46.565386 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-720c4006-6de1-485d-8e1e-d7541b73e604 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:46.566051 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-720c4006-6de1-485d-8e1e-d7541b73e604 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:46.572288 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-720c4006-6de1-485d-8e1e-d7541b73e604 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:46.572754 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-720c4006-6de1-485d-8e1e-d7541b73e604 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:46.573629 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-720c4006-6de1-485d-8e1e-d7541b73e604 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:46.573978 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-720c4006-6de1-485d-8e1e-d7541b73e604 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:46.640817 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-6d95821a-967c-4e86-94fd-c4c3732994ca tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:46.641794 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-6d95821a-967c-4e86-94fd-c4c3732994ca tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:46.648813 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6d95821a-967c-4e86-94fd-c4c3732994ca tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:46.649397 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6d95821a-967c-4e86-94fd-c4c3732994ca tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:46.650294 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6d95821a-967c-4e86-94fd-c4c3732994ca tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:46.650956 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6d95821a-967c-4e86-94fd-c4c3732994ca tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:46.717804 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-6d95821a-967c-4e86-94fd-c4c3732994ca tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:46.725005 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-6d95821a-967c-4e86-94fd-c4c3732994ca tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1241 microversion: 2.1 time: 0.088382 Oct 13 04:17:46.725959 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 36/69] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:46 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:17:46.734752 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-720c4006-6de1-485d-8e1e-d7541b73e604 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:46.741929 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-720c4006-6de1-485d-8e1e-d7541b73e604 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.180214 Oct 13 04:17:46.742481 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 34/70] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:46 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:47.260141 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-82ce7a7e-fe25-4a90-be0f-6d039bc09d26 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:47.260740 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-82ce7a7e-fe25-4a90-be0f-6d039bc09d26 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:47.266769 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-82ce7a7e-fe25-4a90-be0f-6d039bc09d26 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:47.267217 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-82ce7a7e-fe25-4a90-be0f-6d039bc09d26 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:47.268021 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-82ce7a7e-fe25-4a90-be0f-6d039bc09d26 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:47.268431 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-82ce7a7e-fe25-4a90-be0f-6d039bc09d26 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:47.336453 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-82ce7a7e-fe25-4a90-be0f-6d039bc09d26 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:47.344278 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-82ce7a7e-fe25-4a90-be0f-6d039bc09d26 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:47.345812 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-82ce7a7e-fe25-4a90-be0f-6d039bc09d26 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:47.346916 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-82ce7a7e-fe25-4a90-be0f-6d039bc09d26 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1284 microversion: 2.20 time: 0.090571 Oct 13 04:17:47.347479 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 37/71] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:17:47 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:17:47.359177 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7954eac5-ad36-4bab-b0c3-9c1f7f0e4184 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:47.359912 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7954eac5-ad36-4bab-b0c3-9c1f7f0e4184 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:47.366300 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7954eac5-ad36-4bab-b0c3-9c1f7f0e4184 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:47.366750 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7954eac5-ad36-4bab-b0c3-9c1f7f0e4184 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:47.367507 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7954eac5-ad36-4bab-b0c3-9c1f7f0e4184 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:47.367936 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7954eac5-ad36-4bab-b0c3-9c1f7f0e4184 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:47.487394 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-7954eac5-ad36-4bab-b0c3-9c1f7f0e4184 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:47.495021 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7954eac5-ad36-4bab-b0c3-9c1f7f0e4184 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.139534 Oct 13 04:17:47.495580 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 35/72] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:47 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:47.745359 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ac5fcc74-169f-433f-86ee-7a87552b81b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:47.746402 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ac5fcc74-169f-433f-86ee-7a87552b81b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:47.756479 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ac5fcc74-169f-433f-86ee-7a87552b81b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:47.757189 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ac5fcc74-169f-433f-86ee-7a87552b81b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:47.758594 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ac5fcc74-169f-433f-86ee-7a87552b81b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:47.759437 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ac5fcc74-169f-433f-86ee-7a87552b81b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:47.762677 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c13571d9-0558-49cd-b7f2-ecb9ef1b3c17 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:47.763668 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c13571d9-0558-49cd-b7f2-ecb9ef1b3c17 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:47.773409 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c13571d9-0558-49cd-b7f2-ecb9ef1b3c17 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:47.774191 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c13571d9-0558-49cd-b7f2-ecb9ef1b3c17 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:47.775248 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c13571d9-0558-49cd-b7f2-ecb9ef1b3c17 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:47.775674 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c13571d9-0558-49cd-b7f2-ecb9ef1b3c17 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:47.831465 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ac5fcc74-169f-433f-86ee-7a87552b81b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:47.838883 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ac5fcc74-169f-433f-86ee-7a87552b81b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1241 microversion: 2.1 time: 0.099708 Oct 13 04:17:47.839420 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 38/73] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:47 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:47.911557 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-c13571d9-0558-49cd-b7f2-ecb9ef1b3c17 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:47.919911 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c13571d9-0558-49cd-b7f2-ecb9ef1b3c17 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.163479 Oct 13 04:17:47.920471 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 36/74] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:47 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:48.364595 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ec9a1063-0ddc-4432-8c88-00b49cedae79 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:48.365195 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ec9a1063-0ddc-4432-8c88-00b49cedae79 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:48.371382 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ec9a1063-0ddc-4432-8c88-00b49cedae79 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:48.371830 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ec9a1063-0ddc-4432-8c88-00b49cedae79 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:48.372593 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ec9a1063-0ddc-4432-8c88-00b49cedae79 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:48.373024 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ec9a1063-0ddc-4432-8c88-00b49cedae79 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:48.436404 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ec9a1063-0ddc-4432-8c88-00b49cedae79 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:48.447643 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ec9a1063-0ddc-4432-8c88-00b49cedae79 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:48.449394 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ec9a1063-0ddc-4432-8c88-00b49cedae79 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:48.450554 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ec9a1063-0ddc-4432-8c88-00b49cedae79 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1284 microversion: 2.20 time: 0.089662 Oct 13 04:17:48.451085 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 39/75] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:17:48 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:17:48.512269 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5bbb7bb6-9218-47aa-8f6c-7b5d1d5ed54c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:48.512916 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5bbb7bb6-9218-47aa-8f6c-7b5d1d5ed54c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:48.518987 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5bbb7bb6-9218-47aa-8f6c-7b5d1d5ed54c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:48.519430 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5bbb7bb6-9218-47aa-8f6c-7b5d1d5ed54c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:48.520205 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5bbb7bb6-9218-47aa-8f6c-7b5d1d5ed54c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:48.520624 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5bbb7bb6-9218-47aa-8f6c-7b5d1d5ed54c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:48.643919 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5bbb7bb6-9218-47aa-8f6c-7b5d1d5ed54c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:48.651630 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5bbb7bb6-9218-47aa-8f6c-7b5d1d5ed54c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.143436 Oct 13 04:17:48.652367 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 37/76] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:48 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:48.858007 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-eca926f1-8a98-4d79-bcf4-b09e5416e509 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:48.858605 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-eca926f1-8a98-4d79-bcf4-b09e5416e509 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:48.865913 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-eca926f1-8a98-4d79-bcf4-b09e5416e509 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:48.865913 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-eca926f1-8a98-4d79-bcf4-b09e5416e509 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:48.866509 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-eca926f1-8a98-4d79-bcf4-b09e5416e509 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:48.866923 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-eca926f1-8a98-4d79-bcf4-b09e5416e509 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:48.927584 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-eca926f1-8a98-4d79-bcf4-b09e5416e509 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:48.935335 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-eca926f1-8a98-4d79-bcf4-b09e5416e509 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1241 microversion: 2.1 time: 0.080962 Oct 13 04:17:48.936066 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 40/77] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:48 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:48.940271 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-860dab87-bbd3-4063-bf6c-6e2a3f2ce41c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:48.940935 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-860dab87-bbd3-4063-bf6c-6e2a3f2ce41c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:48.947376 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-860dab87-bbd3-4063-bf6c-6e2a3f2ce41c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:48.947996 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-860dab87-bbd3-4063-bf6c-6e2a3f2ce41c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:48.948754 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-860dab87-bbd3-4063-bf6c-6e2a3f2ce41c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:48.949179 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-860dab87-bbd3-4063-bf6c-6e2a3f2ce41c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:49.075557 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-860dab87-bbd3-4063-bf6c-6e2a3f2ce41c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:49.086498 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-860dab87-bbd3-4063-bf6c-6e2a3f2ce41c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.149582 Oct 13 04:17:49.087180 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 38/78] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:48 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:49.472380 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e14bf3a0-df25-4230-8a35-de33a0ec2f43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:49.473369 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e14bf3a0-df25-4230-8a35-de33a0ec2f43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:49.484088 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e14bf3a0-df25-4230-8a35-de33a0ec2f43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:49.484984 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e14bf3a0-df25-4230-8a35-de33a0ec2f43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:49.488370 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e14bf3a0-df25-4230-8a35-de33a0ec2f43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:49.489424 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e14bf3a0-df25-4230-8a35-de33a0ec2f43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:49.569019 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-e14bf3a0-df25-4230-8a35-de33a0ec2f43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:49.579372 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-e14bf3a0-df25-4230-8a35-de33a0ec2f43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:49.581711 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-e14bf3a0-df25-4230-8a35-de33a0ec2f43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:49.583265 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e14bf3a0-df25-4230-8a35-de33a0ec2f43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1284 microversion: 2.20 time: 0.117070 Oct 13 04:17:49.584313 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 41/79] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:17:49 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:17:49.678370 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6accd50f-8a54-4602-80ac-7a4275b3faad tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:49.678959 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6accd50f-8a54-4602-80ac-7a4275b3faad tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:49.685011 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6accd50f-8a54-4602-80ac-7a4275b3faad tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:49.685457 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6accd50f-8a54-4602-80ac-7a4275b3faad tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:49.686271 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6accd50f-8a54-4602-80ac-7a4275b3faad tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:49.686775 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6accd50f-8a54-4602-80ac-7a4275b3faad tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:49.951991 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-63ce04ee-1417-4445-a282-7b59279ede68 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:49.952686 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-63ce04ee-1417-4445-a282-7b59279ede68 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:49.958735 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-63ce04ee-1417-4445-a282-7b59279ede68 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:49.959249 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-63ce04ee-1417-4445-a282-7b59279ede68 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:49.960078 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-63ce04ee-1417-4445-a282-7b59279ede68 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:49.960567 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-63ce04ee-1417-4445-a282-7b59279ede68 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:50.058957 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-63ce04ee-1417-4445-a282-7b59279ede68 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:50.067858 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-63ce04ee-1417-4445-a282-7b59279ede68 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1233 microversion: 2.1 time: 0.119429 Oct 13 04:17:50.068702 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 42/80] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:49 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1233 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:17:50.108200 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7b77363d-8831-43e9-9ec1-00cf0197c52a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:50.108927 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7b77363d-8831-43e9-9ec1-00cf0197c52a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:50.115691 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7b77363d-8831-43e9-9ec1-00cf0197c52a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:50.116201 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7b77363d-8831-43e9-9ec1-00cf0197c52a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:50.117044 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7b77363d-8831-43e9-9ec1-00cf0197c52a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:50.117551 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7b77363d-8831-43e9-9ec1-00cf0197c52a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:50.120128 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6accd50f-8a54-4602-80ac-7a4275b3faad tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:50.133255 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6accd50f-8a54-4602-80ac-7a4275b3faad tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.467462 Oct 13 04:17:50.134584 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 39/81] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:49 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:17:50.303588 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-7b77363d-8831-43e9-9ec1-00cf0197c52a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:50.312065 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7b77363d-8831-43e9-9ec1-00cf0197c52a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.207684 Oct 13 04:17:50.319410 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 43/82] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:50 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:17:50.601750 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9373bfe7-4e0e-4ecf-a25b-87d5c6dd413e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:50.602925 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9373bfe7-4e0e-4ecf-a25b-87d5c6dd413e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:50.616235 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9373bfe7-4e0e-4ecf-a25b-87d5c6dd413e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:50.616666 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9373bfe7-4e0e-4ecf-a25b-87d5c6dd413e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:50.617423 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9373bfe7-4e0e-4ecf-a25b-87d5c6dd413e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:50.618194 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9373bfe7-4e0e-4ecf-a25b-87d5c6dd413e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:50.743485 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-9373bfe7-4e0e-4ecf-a25b-87d5c6dd413e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:50.752879 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-9373bfe7-4e0e-4ecf-a25b-87d5c6dd413e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:50.754528 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-9373bfe7-4e0e-4ecf-a25b-87d5c6dd413e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:50.755923 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9373bfe7-4e0e-4ecf-a25b-87d5c6dd413e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1276 microversion: 2.20 time: 0.158543 Oct 13 04:17:50.756731 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 40/83] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:17:50 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:17:50.831534 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-21b938d5-d0d5-4aea-8971-0d7d10fbb5e0 req-ae82dd29-8aeb-4cdf-8793-0915c1cbb3ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d91ac1af-2378-4b6f-9ca7-08181ffe7d44", "tag": "0d108316-b79c-4ebf-af4e-9237f069cd94"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:17:50.835863 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:17:50.835863 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:17:50.853482 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-21b938d5-d0d5-4aea-8971-0d7d10fbb5e0 req-ae82dd29-8aeb-4cdf-8793-0915c1cbb3ea service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:50.854910 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-21b938d5-d0d5-4aea-8971-0d7d10fbb5e0 req-ae82dd29-8aeb-4cdf-8793-0915c1cbb3ea service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:50.873001 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-1931bd65-6092-4a78-85b7-6e5a254ac4ef req-f6c6da5d-fbeb-465a-8f84-d42f8cb4c27b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ddad073-1d60-49aa-808b-97fd2684790f", "tag": "02af8261-af42-436d-81a0-3ab22dbcea77"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:17:50.875572 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:17:50.875572 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:17:50.886399 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-1931bd65-6092-4a78-85b7-6e5a254ac4ef req-f6c6da5d-fbeb-465a-8f84-d42f8cb4c27b service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:50.887141 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-1931bd65-6092-4a78-85b7-6e5a254ac4ef req-f6c6da5d-fbeb-465a-8f84-d42f8cb4c27b service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:50.900715 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-21b938d5-d0d5-4aea-8971-0d7d10fbb5e0 req-ae82dd29-8aeb-4cdf-8793-0915c1cbb3ea service nova] Creating event network-changed:0d108316-b79c-4ebf-af4e-9237f069cd94 for instance d91ac1af-2378-4b6f-9ca7-08181ffe7d44 on hv-cinder-81275 Oct 13 04:17:50.901239 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-21b938d5-d0d5-4aea-8971-0d7d10fbb5e0 req-ae82dd29-8aeb-4cdf-8793-0915c1cbb3ea service nova] Acquired lock "compute-rpcapi-router" {{(pid=108259) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 13 04:17:50.902425 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-be14a9f2-658b-4f00-99ae-7e8570ddcfdd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:50.902857 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-be14a9f2-658b-4f00-99ae-7e8570ddcfdd None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:50.905559 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-be14a9f2-658b-4f00-99ae-7e8570ddcfdd None None] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:50.909294 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-be14a9f2-658b-4f00-99ae-7e8570ddcfdd None None] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:50.910062 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-1931bd65-6092-4a78-85b7-6e5a254ac4ef req-f6c6da5d-fbeb-465a-8f84-d42f8cb4c27b service nova] Creating event network-changed:02af8261-af42-436d-81a0-3ab22dbcea77 for instance 0ddad073-1d60-49aa-808b-97fd2684790f on hv-cinder-81275 Oct 13 04:17:50.910979 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-1931bd65-6092-4a78-85b7-6e5a254ac4ef req-f6c6da5d-fbeb-465a-8f84-d42f8cb4c27b service nova] Acquired lock "compute-rpcapi-router" {{(pid=108260) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 13 04:17:50.912308 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-eb8aaaf0-87be-415f-8db1-b6cb4b84db74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:50.912944 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-eb8aaaf0-87be-415f-8db1-b6cb4b84db74 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:50.913947 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-eb8aaaf0-87be-415f-8db1-b6cb4b84db74 None None] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:50.914942 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-eb8aaaf0-87be-415f-8db1-b6cb4b84db74 None None] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:50.919445 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.compute.rpcapi [None req-be14a9f2-658b-4f00-99ae-7e8570ddcfdd None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 13 04:17:50.920344 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-be14a9f2-658b-4f00-99ae-7e8570ddcfdd None None] Releasing lock "compute-rpcapi-router" {{(pid=108259) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 13 04:17:50.924984 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.compute.rpcapi [None req-eb8aaaf0-87be-415f-8db1-b6cb4b84db74 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 13 04:17:50.926193 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-eb8aaaf0-87be-415f-8db1-b6cb4b84db74 None None] Releasing lock "compute-rpcapi-router" {{(pid=108260) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 13 04:17:50.966819 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-be14a9f2-658b-4f00-99ae-7e8570ddcfdd None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195954 Oct 13 04:17:50.968444 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 44/84] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:17:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:17:50.970923 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-eb8aaaf0-87be-415f-8db1-b6cb4b84db74 None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169092 Oct 13 04:17:50.971996 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 41/85] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:17:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:17:51.085697 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-97c964aa-9ad5-4937-810f-2651ab47d51c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:51.086648 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-97c964aa-9ad5-4937-810f-2651ab47d51c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:51.093216 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-97c964aa-9ad5-4937-810f-2651ab47d51c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:51.093992 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-97c964aa-9ad5-4937-810f-2651ab47d51c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:51.094762 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-97c964aa-9ad5-4937-810f-2651ab47d51c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:51.095435 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-97c964aa-9ad5-4937-810f-2651ab47d51c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:51.155473 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-49ad2632-5e43-4a85-860a-9e6118610e22 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:51.156224 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-49ad2632-5e43-4a85-860a-9e6118610e22 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:51.171055 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49ad2632-5e43-4a85-860a-9e6118610e22 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:51.171920 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49ad2632-5e43-4a85-860a-9e6118610e22 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:51.172977 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49ad2632-5e43-4a85-860a-9e6118610e22 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:51.173810 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49ad2632-5e43-4a85-860a-9e6118610e22 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:51.361020 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-97c964aa-9ad5-4937-810f-2651ab47d51c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:51.373583 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-97c964aa-9ad5-4937-810f-2651ab47d51c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1297 microversion: 2.1 time: 0.291854 Oct 13 04:17:51.374868 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 45/86] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:51 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1297 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:51.385797 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-67ad7f09-6f31-43a2-adcf-c26cb8bca1cd tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:51.386800 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-67ad7f09-6f31-43a2-adcf-c26cb8bca1cd tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:51.397485 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-67ad7f09-6f31-43a2-adcf-c26cb8bca1cd tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:51.398347 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-67ad7f09-6f31-43a2-adcf-c26cb8bca1cd tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:51.399727 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-67ad7f09-6f31-43a2-adcf-c26cb8bca1cd tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:51.400089 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-67ad7f09-6f31-43a2-adcf-c26cb8bca1cd tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:51.773294 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-49ad2632-5e43-4a85-860a-9e6118610e22 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:51.781453 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-49ad2632-5e43-4a85-860a-9e6118610e22 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.633065 Oct 13 04:17:51.784136 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 42/87] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:51 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:51.794183 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f9adabc8-e85f-4f30-b11f-f50bc8f9f989 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:51.794788 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f9adabc8-e85f-4f30-b11f-f50bc8f9f989 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:51.813178 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f9adabc8-e85f-4f30-b11f-f50bc8f9f989 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:51.813652 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f9adabc8-e85f-4f30-b11f-f50bc8f9f989 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:51.814442 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f9adabc8-e85f-4f30-b11f-f50bc8f9f989 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:51.814865 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f9adabc8-e85f-4f30-b11f-f50bc8f9f989 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:51.986835 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f9adabc8-e85f-4f30-b11f-f50bc8f9f989 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:52.012685 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f9adabc8-e85f-4f30-b11f-f50bc8f9f989 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:52.019139 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f9adabc8-e85f-4f30-b11f-f50bc8f9f989 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:52.021797 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f9adabc8-e85f-4f30-b11f-f50bc8f9f989 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1338 microversion: 2.20 time: 0.235333 Oct 13 04:17:52.023068 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 43/88] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:17:51 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1338 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:17:52.082305 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-67ad7f09-6f31-43a2-adcf-c26cb8bca1cd tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:52.098492 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-67ad7f09-6f31-43a2-adcf-c26cb8bca1cd tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.722257 Oct 13 04:17:52.099143 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 46/89] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:51 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:52.392244 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5f08e62f-4b42-4a4c-b9af-89a3e648fdf0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:52.393685 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5f08e62f-4b42-4a4c-b9af-89a3e648fdf0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:52.403656 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5f08e62f-4b42-4a4c-b9af-89a3e648fdf0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:52.404670 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5f08e62f-4b42-4a4c-b9af-89a3e648fdf0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:52.405737 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5f08e62f-4b42-4a4c-b9af-89a3e648fdf0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:52.406481 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5f08e62f-4b42-4a4c-b9af-89a3e648fdf0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:52.565311 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5f08e62f-4b42-4a4c-b9af-89a3e648fdf0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:52.578008 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5f08e62f-4b42-4a4c-b9af-89a3e648fdf0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1295 microversion: 2.1 time: 0.190079 Oct 13 04:17:52.578629 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 44/90] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:52 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1295 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:52.800680 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-dd2afd62-75e2-413c-b4f7-486448dc128e tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:52.801402 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-dd2afd62-75e2-413c-b4f7-486448dc128e tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:52.807675 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dd2afd62-75e2-413c-b4f7-486448dc128e tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:52.808507 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dd2afd62-75e2-413c-b4f7-486448dc128e tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:52.809303 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dd2afd62-75e2-413c-b4f7-486448dc128e tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:52.809891 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dd2afd62-75e2-413c-b4f7-486448dc128e tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:53.042043 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2b09eab7-8860-4491-959b-0df83682214b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:53.042643 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-2b09eab7-8860-4491-959b-0df83682214b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:53.053597 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2b09eab7-8860-4491-959b-0df83682214b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:53.054208 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2b09eab7-8860-4491-959b-0df83682214b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:53.055145 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2b09eab7-8860-4491-959b-0df83682214b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:53.055563 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2b09eab7-8860-4491-959b-0df83682214b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:53.350479 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-2b09eab7-8860-4491-959b-0df83682214b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:53.360510 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-2b09eab7-8860-4491-959b-0df83682214b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:53.363541 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-2b09eab7-8860-4491-959b-0df83682214b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:53.364693 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-2b09eab7-8860-4491-959b-0df83682214b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1338 microversion: 2.20 time: 0.327594 Oct 13 04:17:53.380205 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 45/91] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:17:53 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1338 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 04:17:53.388483 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-fc521942-bd2b-43f2-b23b-ad9b43daa4f3 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:53.390666 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-fc521942-bd2b-43f2-b23b-ad9b43daa4f3 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:53.411715 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fc521942-bd2b-43f2-b23b-ad9b43daa4f3 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:53.415323 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fc521942-bd2b-43f2-b23b-ad9b43daa4f3 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:53.417538 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-dd2afd62-75e2-413c-b4f7-486448dc128e tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:53.418490 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fc521942-bd2b-43f2-b23b-ad9b43daa4f3 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:53.422043 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fc521942-bd2b-43f2-b23b-ad9b43daa4f3 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:53.433187 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-dd2afd62-75e2-413c-b4f7-486448dc128e tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.635936 Oct 13 04:17:53.433774 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 47/92] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:52 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:53.597281 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1c7ceb22-947d-443c-ac80-74419ad81e67 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:53.598046 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1c7ceb22-947d-443c-ac80-74419ad81e67 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:53.606280 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1c7ceb22-947d-443c-ac80-74419ad81e67 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:53.607094 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1c7ceb22-947d-443c-ac80-74419ad81e67 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:53.608983 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1c7ceb22-947d-443c-ac80-74419ad81e67 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:53.613326 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1c7ceb22-947d-443c-ac80-74419ad81e67 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:54.055385 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-fc521942-bd2b-43f2-b23b-ad9b43daa4f3 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:54.069653 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-fc521942-bd2b-43f2-b23b-ad9b43daa4f3 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.686468 Oct 13 04:17:54.071241 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 46/93] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:53 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:54.199210 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1c7ceb22-947d-443c-ac80-74419ad81e67 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:54.207626 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1c7ceb22-947d-443c-ac80-74419ad81e67 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1363 microversion: 2.1 time: 0.614735 Oct 13 04:17:54.208199 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 48/94] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:53 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1363 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:54.382649 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-14123131-9509-47c9-b111-412db08e4f5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:54.383305 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-14123131-9509-47c9-b111-412db08e4f5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:54.391382 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-14123131-9509-47c9-b111-412db08e4f5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:54.392045 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-14123131-9509-47c9-b111-412db08e4f5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:54.393524 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-14123131-9509-47c9-b111-412db08e4f5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:54.394177 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-14123131-9509-47c9-b111-412db08e4f5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:54.450318 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c94031a7-4e5a-454f-b1ec-a047bb5da7bb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:54.451646 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c94031a7-4e5a-454f-b1ec-a047bb5da7bb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:54.457756 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c94031a7-4e5a-454f-b1ec-a047bb5da7bb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:54.458282 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c94031a7-4e5a-454f-b1ec-a047bb5da7bb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:54.459328 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c94031a7-4e5a-454f-b1ec-a047bb5da7bb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:54.459751 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c94031a7-4e5a-454f-b1ec-a047bb5da7bb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:54.869934 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-14123131-9509-47c9-b111-412db08e4f5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:54.877971 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-14123131-9509-47c9-b111-412db08e4f5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:54.879484 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-14123131-9509-47c9-b111-412db08e4f5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:54.880625 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-14123131-9509-47c9-b111-412db08e4f5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1406 microversion: 2.20 time: 0.501700 Oct 13 04:17:54.881229 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 47/95] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:17:54 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1406 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:17:54.944574 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c94031a7-4e5a-454f-b1ec-a047bb5da7bb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:54.956718 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c94031a7-4e5a-454f-b1ec-a047bb5da7bb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.507700 Oct 13 04:17:54.959078 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 49/96] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:54 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:17:55.092017 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7af80f58-f6e6-46cb-83ba-88e4c553dca7 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:55.092906 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7af80f58-f6e6-46cb-83ba-88e4c553dca7 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:55.103026 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7af80f58-f6e6-46cb-83ba-88e4c553dca7 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:55.103883 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7af80f58-f6e6-46cb-83ba-88e4c553dca7 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:55.105764 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7af80f58-f6e6-46cb-83ba-88e4c553dca7 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:55.128146 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7af80f58-f6e6-46cb-83ba-88e4c553dca7 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:55.225030 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b8bc3df4-7b81-42b7-997a-35be50cfb8b6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:55.226274 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b8bc3df4-7b81-42b7-997a-35be50cfb8b6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:55.237393 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b8bc3df4-7b81-42b7-997a-35be50cfb8b6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:55.239403 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b8bc3df4-7b81-42b7-997a-35be50cfb8b6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:55.242129 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b8bc3df4-7b81-42b7-997a-35be50cfb8b6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:55.242808 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b8bc3df4-7b81-42b7-997a-35be50cfb8b6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:55.540101 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-7af80f58-f6e6-46cb-83ba-88e4c553dca7 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:55.549696 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7af80f58-f6e6-46cb-83ba-88e4c553dca7 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.464670 Oct 13 04:17:55.550293 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 48/97] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:55 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:55.877836 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-0b058b68-80d1-4769-8278-a8e439b4f7b0 req-08202be2-6960-4766-b822-b5f984c31461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c2b8a8f-db02-4581-b497-1f4caa68240f", "tag": "819b5060-2257-431d-a719-93e3e23c273c"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:17:55.879546 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:17:55.879546 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:17:55.883672 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b8bc3df4-7b81-42b7-997a-35be50cfb8b6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:55.895549 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b8bc3df4-7b81-42b7-997a-35be50cfb8b6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1363 microversion: 2.1 time: 0.672069 Oct 13 04:17:55.896370 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 50/98] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:55 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1363 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:55.900936 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-0b058b68-80d1-4769-8278-a8e439b4f7b0 req-08202be2-6960-4766-b822-b5f984c31461 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:55.901384 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-0b058b68-80d1-4769-8278-a8e439b4f7b0 req-08202be2-6960-4766-b822-b5f984c31461 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:55.907735 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-aa64ea2d-ea62-47c3-a4e6-cd3644168664 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:55.910651 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-aa64ea2d-ea62-47c3-a4e6-cd3644168664 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:55.925185 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aa64ea2d-ea62-47c3-a4e6-cd3644168664 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:55.926119 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aa64ea2d-ea62-47c3-a4e6-cd3644168664 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:55.931902 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aa64ea2d-ea62-47c3-a4e6-cd3644168664 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:55.932170 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-0b058b68-80d1-4769-8278-a8e439b4f7b0 req-08202be2-6960-4766-b822-b5f984c31461 service nova] Creating event network-changed:819b5060-2257-431d-a719-93e3e23c273c for instance 3c2b8a8f-db02-4581-b497-1f4caa68240f on hv-cinder-81275 Oct 13 04:17:55.932695 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aa64ea2d-ea62-47c3-a4e6-cd3644168664 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:55.943831 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-0b058b68-80d1-4769-8278-a8e439b4f7b0 req-08202be2-6960-4766-b822-b5f984c31461 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070236 Oct 13 04:17:55.946952 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 49/99] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:17:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:17:55.977192 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-8971bdeb-0444-470d-8596-397e0d3bc134 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:55.978086 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-8971bdeb-0444-470d-8596-397e0d3bc134 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:55.994484 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8971bdeb-0444-470d-8596-397e0d3bc134 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:55.994925 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8971bdeb-0444-470d-8596-397e0d3bc134 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:55.995691 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8971bdeb-0444-470d-8596-397e0d3bc134 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:55.996114 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8971bdeb-0444-470d-8596-397e0d3bc134 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:56.565461 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-aa64ea2d-ea62-47c3-a4e6-cd3644168664 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:56.576729 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-aa64ea2d-ea62-47c3-a4e6-cd3644168664 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:56.580812 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-aa64ea2d-ea62-47c3-a4e6-cd3644168664 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:56.583703 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-aa64ea2d-ea62-47c3-a4e6-cd3644168664 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1406 microversion: 2.20 time: 0.685581 Oct 13 04:17:56.597489 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 51/100] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:17:55 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1406 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:17:56.612760 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-deaaebd5-9255-4a61-9660-4c1b56a54a0a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:56.613373 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-deaaebd5-9255-4a61-9660-4c1b56a54a0a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:56.613730 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-8971bdeb-0444-470d-8596-397e0d3bc134 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:56.621630 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-8971bdeb-0444-470d-8596-397e0d3bc134 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.648419 Oct 13 04:17:56.625404 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 50/101] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:55 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:17:56.640001 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-deaaebd5-9255-4a61-9660-4c1b56a54a0a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:56.640453 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-deaaebd5-9255-4a61-9660-4c1b56a54a0a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:56.641252 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-deaaebd5-9255-4a61-9660-4c1b56a54a0a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:56.641736 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-deaaebd5-9255-4a61-9660-4c1b56a54a0a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:56.915137 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d15d8d28-6c1f-4703-b1f5-89c7855ac892 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:56.916398 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d15d8d28-6c1f-4703-b1f5-89c7855ac892 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:56.927238 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d15d8d28-6c1f-4703-b1f5-89c7855ac892 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:56.927689 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d15d8d28-6c1f-4703-b1f5-89c7855ac892 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:56.931973 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d15d8d28-6c1f-4703-b1f5-89c7855ac892 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:56.932417 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d15d8d28-6c1f-4703-b1f5-89c7855ac892 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:57.139987 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-deaaebd5-9255-4a61-9660-4c1b56a54a0a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:57.151177 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-deaaebd5-9255-4a61-9660-4c1b56a54a0a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.548056 Oct 13 04:17:57.151862 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 52/102] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:56 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:57.371886 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d15d8d28-6c1f-4703-b1f5-89c7855ac892 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:57.385313 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d15d8d28-6c1f-4703-b1f5-89c7855ac892 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1363 microversion: 2.1 time: 0.474355 Oct 13 04:17:57.386712 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 51/103] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:56 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1363 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:57.604030 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-079585c8-264f-41a7-b156-545a93fab087 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:57.604795 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-079585c8-264f-41a7-b156-545a93fab087 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:57.614184 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-079585c8-264f-41a7-b156-545a93fab087 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:57.616406 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-079585c8-264f-41a7-b156-545a93fab087 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:57.620724 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-079585c8-264f-41a7-b156-545a93fab087 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:57.621843 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-079585c8-264f-41a7-b156-545a93fab087 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:57.644440 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-095cae8e-b85b-4cd1-815e-e4a8359e5e63 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:57.645439 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-095cae8e-b85b-4cd1-815e-e4a8359e5e63 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:57.655817 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-095cae8e-b85b-4cd1-815e-e4a8359e5e63 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:57.656259 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-095cae8e-b85b-4cd1-815e-e4a8359e5e63 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:57.658819 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-095cae8e-b85b-4cd1-815e-e4a8359e5e63 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:57.659252 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-095cae8e-b85b-4cd1-815e-e4a8359e5e63 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:57.938044 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-079585c8-264f-41a7-b156-545a93fab087 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:57.948716 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-079585c8-264f-41a7-b156-545a93fab087 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:57.950227 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-079585c8-264f-41a7-b156-545a93fab087 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:57.951327 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-079585c8-264f-41a7-b156-545a93fab087 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1406 microversion: 2.20 time: 0.353556 Oct 13 04:17:57.951882 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 53/104] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:17:57 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1406 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:17:57.981688 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-6bbd73e1-4812-49f0-af41-023985fad245 req-6998f718-78f1-4637-b5d6-b72e1421b05a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a527ca0-f4d9-4478-8737-56edd7fe83fc", "tag": "2bf8b44d-dd7e-4a64-bef6-74e34e11e05f"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:17:57.983482 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:17:57.983482 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:17:57.991657 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-6bbd73e1-4812-49f0-af41-023985fad245 req-6998f718-78f1-4637-b5d6-b72e1421b05a service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:57.992454 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-6bbd73e1-4812-49f0-af41-023985fad245 req-6998f718-78f1-4637-b5d6-b72e1421b05a service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:58.004766 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-6bbd73e1-4812-49f0-af41-023985fad245 req-6998f718-78f1-4637-b5d6-b72e1421b05a service nova] Creating event network-changed:2bf8b44d-dd7e-4a64-bef6-74e34e11e05f for instance 6a527ca0-f4d9-4478-8737-56edd7fe83fc on hv-cinder-81275 Oct 13 04:17:58.011464 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-6bbd73e1-4812-49f0-af41-023985fad245 req-6998f718-78f1-4637-b5d6-b72e1421b05a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033037 Oct 13 04:17:58.012391 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 54/105] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:17:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:17:58.015619 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-095cae8e-b85b-4cd1-815e-e4a8359e5e63 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:58.024450 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-095cae8e-b85b-4cd1-815e-e4a8359e5e63 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.383718 Oct 13 04:17:58.035574 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 52/106] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:57 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:58.169512 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2295145c-a875-4e36-ad18-916bcf2f9cac tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:58.170248 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2295145c-a875-4e36-ad18-916bcf2f9cac tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:58.182447 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2295145c-a875-4e36-ad18-916bcf2f9cac tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:58.182827 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2295145c-a875-4e36-ad18-916bcf2f9cac tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:58.183606 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2295145c-a875-4e36-ad18-916bcf2f9cac tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:58.188122 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2295145c-a875-4e36-ad18-916bcf2f9cac tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:58.404086 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-da04cfd4-610f-4183-aa72-aa0112571c0d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:58.404976 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-da04cfd4-610f-4183-aa72-aa0112571c0d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:58.415308 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-da04cfd4-610f-4183-aa72-aa0112571c0d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:58.416016 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-da04cfd4-610f-4183-aa72-aa0112571c0d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:58.418695 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-da04cfd4-610f-4183-aa72-aa0112571c0d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:58.419270 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-da04cfd4-610f-4183-aa72-aa0112571c0d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:58.904620 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-da04cfd4-610f-4183-aa72-aa0112571c0d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:58.905258 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2295145c-a875-4e36-ad18-916bcf2f9cac tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:58.921524 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-da04cfd4-610f-4183-aa72-aa0112571c0d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1363 microversion: 2.1 time: 0.521231 Oct 13 04:17:58.923112 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2295145c-a875-4e36-ad18-916bcf2f9cac tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.757692 Oct 13 04:17:58.923864 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 53/107] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:58 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1363 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:58.933767 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 55/108] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:58 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:58.971120 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ea473c36-d2ef-4b2c-ab58-e456e0ef2d6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:58.972386 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ea473c36-d2ef-4b2c-ab58-e456e0ef2d6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:58.979522 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ea473c36-d2ef-4b2c-ab58-e456e0ef2d6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:58.980490 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ea473c36-d2ef-4b2c-ab58-e456e0ef2d6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:58.981715 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ea473c36-d2ef-4b2c-ab58-e456e0ef2d6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:58.982531 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ea473c36-d2ef-4b2c-ab58-e456e0ef2d6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:59.043091 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5b9548cf-9942-43c7-a172-bbcb6dd6fabb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:59.043873 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-5b9548cf-9942-43c7-a172-bbcb6dd6fabb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:59.051041 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5b9548cf-9942-43c7-a172-bbcb6dd6fabb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:59.051723 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5b9548cf-9942-43c7-a172-bbcb6dd6fabb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:59.052630 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5b9548cf-9942-43c7-a172-bbcb6dd6fabb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:59.053189 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5b9548cf-9942-43c7-a172-bbcb6dd6fabb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:59.301872 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-ea473c36-d2ef-4b2c-ab58-e456e0ef2d6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:59.316066 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-5b9548cf-9942-43c7-a172-bbcb6dd6fabb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:59.316728 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-ea473c36-d2ef-4b2c-ab58-e456e0ef2d6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:59.319756 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-ea473c36-d2ef-4b2c-ab58-e456e0ef2d6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:17:59.321422 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ea473c36-d2ef-4b2c-ab58-e456e0ef2d6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1406 microversion: 2.20 time: 0.355539 Oct 13 04:17:59.322589 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 54/109] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:17:58 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1406 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:17:59.323315 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-5b9548cf-9942-43c7-a172-bbcb6dd6fabb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.285392 Oct 13 04:17:59.332852 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 56/110] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:59 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:17:59.940714 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-cd79b395-029f-45b1-9340-712f4cc317b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:59.941996 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-cd79b395-029f-45b1-9340-712f4cc317b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:59.949195 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a0215f89-f3e8-42b9-b016-47c00c2d8238 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:17:59.949828 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a0215f89-f3e8-42b9-b016-47c00c2d8238 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:17:59.957055 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a0215f89-f3e8-42b9-b016-47c00c2d8238 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:59.957484 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a0215f89-f3e8-42b9-b016-47c00c2d8238 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:59.958545 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a0215f89-f3e8-42b9-b016-47c00c2d8238 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:59.958711 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a0215f89-f3e8-42b9-b016-47c00c2d8238 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:59.978604 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cd79b395-029f-45b1-9340-712f4cc317b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:59.979359 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cd79b395-029f-45b1-9340-712f4cc317b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:17:59.980349 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cd79b395-029f-45b1-9340-712f4cc317b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:17:59.981509 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cd79b395-029f-45b1-9340-712f4cc317b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:00.197282 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a0215f89-f3e8-42b9-b016-47c00c2d8238 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:00.204970 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-cd79b395-029f-45b1-9340-712f4cc317b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:00.217564 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a0215f89-f3e8-42b9-b016-47c00c2d8238 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.268155 Oct 13 04:18:00.218425 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 57/111] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:59 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:18:00.219092 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-cd79b395-029f-45b1-9340-712f4cc317b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1363 microversion: 2.1 time: 0.281410 Oct 13 04:18:00.220143 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 55/112] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:17:59 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:00.339235 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9ee6872b-53f9-4082-88db-d45bc021b18e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:00.340635 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9ee6872b-53f9-4082-88db-d45bc021b18e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:00.347052 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9ee6872b-53f9-4082-88db-d45bc021b18e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:00.347970 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9ee6872b-53f9-4082-88db-d45bc021b18e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:00.348968 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9ee6872b-53f9-4082-88db-d45bc021b18e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:00.349646 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9ee6872b-53f9-4082-88db-d45bc021b18e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:00.384827 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-bb0f0c34-a807-4778-bb38-930046cde46c req-fbd0bfce-aebb-4214-bec1-6b276173d2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91ac1af-2378-4b6f-9ca7-08181ffe7d44", "name": "network-vif-plugged", "status": "completed", "tag": "0d108316-b79c-4ebf-af4e-9237f069cd94"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:00.386549 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:18:00.386549 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:18:00.397594 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-bb0f0c34-a807-4778-bb38-930046cde46c req-fbd0bfce-aebb-4214-bec1-6b276173d2f5 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:00.397926 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-bb0f0c34-a807-4778-bb38-930046cde46c req-fbd0bfce-aebb-4214-bec1-6b276173d2f5 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:00.423260 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-bb0f0c34-a807-4778-bb38-930046cde46c req-fbd0bfce-aebb-4214-bec1-6b276173d2f5 service nova] Creating event network-vif-plugged:0d108316-b79c-4ebf-af4e-9237f069cd94 for instance d91ac1af-2378-4b6f-9ca7-08181ffe7d44 on hv-cinder-81275 Oct 13 04:18:00.428967 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-bb0f0c34-a807-4778-bb38-930046cde46c req-fbd0bfce-aebb-4214-bec1-6b276173d2f5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103033 Oct 13 04:18:00.430696 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 58/113] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:18:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:18:00.437984 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8b053e1c-5874-4336-b255-7477949e37f2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:00.438892 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-8b053e1c-5874-4336-b255-7477949e37f2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:00.445656 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8b053e1c-5874-4336-b255-7477949e37f2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:00.447099 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8b053e1c-5874-4336-b255-7477949e37f2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:00.448099 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8b053e1c-5874-4336-b255-7477949e37f2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:00.448913 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8b053e1c-5874-4336-b255-7477949e37f2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:00.548472 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-9ee6872b-53f9-4082-88db-d45bc021b18e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:00.557509 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-9ee6872b-53f9-4082-88db-d45bc021b18e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:00.561131 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-9ee6872b-53f9-4082-88db-d45bc021b18e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:00.562305 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9ee6872b-53f9-4082-88db-d45bc021b18e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1406 microversion: 2.20 time: 0.226995 Oct 13 04:18:00.562889 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 56/114] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:18:00 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 04:18:00.671202 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-8b053e1c-5874-4336-b255-7477949e37f2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:00.690668 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-8b053e1c-5874-4336-b255-7477949e37f2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.258338 Oct 13 04:18:00.699961 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 59/115] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:00 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:01.235802 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-098e791a-7492-4f03-953a-fb62515d5f65 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:01.236832 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-098e791a-7492-4f03-953a-fb62515d5f65 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:01.243974 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8e6e0ce5-af26-4d7d-8cd0-a26288a24fe5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:01.244584 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-8e6e0ce5-af26-4d7d-8cd0-a26288a24fe5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:01.246881 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-098e791a-7492-4f03-953a-fb62515d5f65 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:01.247561 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-098e791a-7492-4f03-953a-fb62515d5f65 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:01.249058 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-098e791a-7492-4f03-953a-fb62515d5f65 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:01.250102 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-098e791a-7492-4f03-953a-fb62515d5f65 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:01.251372 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8e6e0ce5-af26-4d7d-8cd0-a26288a24fe5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:01.251868 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8e6e0ce5-af26-4d7d-8cd0-a26288a24fe5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:01.253684 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8e6e0ce5-af26-4d7d-8cd0-a26288a24fe5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:01.253684 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8e6e0ce5-af26-4d7d-8cd0-a26288a24fe5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:01.491197 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-8e6e0ce5-af26-4d7d-8cd0-a26288a24fe5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:01.499740 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-8e6e0ce5-af26-4d7d-8cd0-a26288a24fe5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1363 microversion: 2.1 time: 0.260083 Oct 13 04:18:01.500313 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 60/116] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:01 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:01.509427 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-098e791a-7492-4f03-953a-fb62515d5f65 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:01.509950 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-098e791a-7492-4f03-953a-fb62515d5f65 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.278813 Oct 13 04:18:01.510455 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 57/117] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:01 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:01.580395 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-56648c3d-2a57-42be-bbb2-1a1f678621b6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:01.580958 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-56648c3d-2a57-42be-bbb2-1a1f678621b6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:01.587581 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-56648c3d-2a57-42be-bbb2-1a1f678621b6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:01.588075 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-56648c3d-2a57-42be-bbb2-1a1f678621b6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:01.588813 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-56648c3d-2a57-42be-bbb2-1a1f678621b6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:01.589236 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-56648c3d-2a57-42be-bbb2-1a1f678621b6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:01.707518 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1756884e-10ea-44df-93f4-de0ad3cfe8e5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:01.708263 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-1756884e-10ea-44df-93f4-de0ad3cfe8e5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:01.709729 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-56648c3d-2a57-42be-bbb2-1a1f678621b6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:01.715814 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1756884e-10ea-44df-93f4-de0ad3cfe8e5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:01.716565 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1756884e-10ea-44df-93f4-de0ad3cfe8e5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:01.717407 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1756884e-10ea-44df-93f4-de0ad3cfe8e5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:01.717948 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1756884e-10ea-44df-93f4-de0ad3cfe8e5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:01.718063 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-56648c3d-2a57-42be-bbb2-1a1f678621b6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:01.719483 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-56648c3d-2a57-42be-bbb2-1a1f678621b6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:01.720572 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-56648c3d-2a57-42be-bbb2-1a1f678621b6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1406 microversion: 2.20 time: 0.144048 Oct 13 04:18:01.721396 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 61/118] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:18:01 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1406 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 04:18:01.877193 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-1756884e-10ea-44df-93f4-de0ad3cfe8e5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:01.885709 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-1756884e-10ea-44df-93f4-de0ad3cfe8e5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.181886 Oct 13 04:18:01.886537 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 58/119] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:01 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:02.451556 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-394b1402-1761-428d-96b3-a57353a3ae32 req-4f70fe13-0ac1-48b1-a115-4bb181b54320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ddad073-1d60-49aa-808b-97fd2684790f", "name": "network-vif-plugged", "status": "completed", "tag": "02af8261-af42-436d-81a0-3ab22dbcea77"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:02.454807 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:18:02.454807 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:18:02.463237 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-394b1402-1761-428d-96b3-a57353a3ae32 req-4f70fe13-0ac1-48b1-a115-4bb181b54320 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:02.464851 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-394b1402-1761-428d-96b3-a57353a3ae32 req-4f70fe13-0ac1-48b1-a115-4bb181b54320 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:02.497687 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-394b1402-1761-428d-96b3-a57353a3ae32 req-4f70fe13-0ac1-48b1-a115-4bb181b54320 service nova] Creating event network-vif-plugged:02af8261-af42-436d-81a0-3ab22dbcea77 for instance 0ddad073-1d60-49aa-808b-97fd2684790f on hv-cinder-81275 Oct 13 04:18:02.524100 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-0ca2dae8-2a6e-4768-9177-7d532b692a78 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:02.526798 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-0ca2dae8-2a6e-4768-9177-7d532b692a78 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:02.527967 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-394b1402-1761-428d-96b3-a57353a3ae32 req-4f70fe13-0ac1-48b1-a115-4bb181b54320 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074177 Oct 13 04:18:02.531938 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 62/120] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:18:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:18:02.534131 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0ca2dae8-2a6e-4768-9177-7d532b692a78 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:02.534844 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0ca2dae8-2a6e-4768-9177-7d532b692a78 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:02.537458 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0ca2dae8-2a6e-4768-9177-7d532b692a78 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:02.538095 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0ca2dae8-2a6e-4768-9177-7d532b692a78 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:02.564297 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-525c0346-a7f3-4ddf-8c80-237e0dac8b75 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:02.569302 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-525c0346-a7f3-4ddf-8c80-237e0dac8b75 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:02.588018 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-525c0346-a7f3-4ddf-8c80-237e0dac8b75 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:02.588472 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-525c0346-a7f3-4ddf-8c80-237e0dac8b75 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:02.594407 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-525c0346-a7f3-4ddf-8c80-237e0dac8b75 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:02.595053 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-525c0346-a7f3-4ddf-8c80-237e0dac8b75 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:02.814365 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-0ca2dae8-2a6e-4768-9177-7d532b692a78 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:02.821687 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-0ca2dae8-2a6e-4768-9177-7d532b692a78 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1363 microversion: 2.1 time: 0.306574 Oct 13 04:18:02.822271 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 59/121] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:02 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:02.838936 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4499eaf1-5872-4018-853e-8beca8d90ce7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:02.839724 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4499eaf1-5872-4018-853e-8beca8d90ce7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:02.846595 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4499eaf1-5872-4018-853e-8beca8d90ce7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:02.847238 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4499eaf1-5872-4018-853e-8beca8d90ce7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:02.848222 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4499eaf1-5872-4018-853e-8beca8d90ce7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:02.848844 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4499eaf1-5872-4018-853e-8beca8d90ce7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:02.881937 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-525c0346-a7f3-4ddf-8c80-237e0dac8b75 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:02.889419 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-525c0346-a7f3-4ddf-8c80-237e0dac8b75 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.354885 Oct 13 04:18:02.890044 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 63/122] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:02 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:02.904191 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f4db8844-2c87-4c09-b32d-4a7912065948 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:02.904786 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f4db8844-2c87-4c09-b32d-4a7912065948 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:02.917544 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f4db8844-2c87-4c09-b32d-4a7912065948 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:02.918019 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f4db8844-2c87-4c09-b32d-4a7912065948 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:02.918785 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f4db8844-2c87-4c09-b32d-4a7912065948 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:02.919211 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f4db8844-2c87-4c09-b32d-4a7912065948 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:03.213073 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4499eaf1-5872-4018-853e-8beca8d90ce7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:03.222892 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f4db8844-2c87-4c09-b32d-4a7912065948 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:03.226804 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4499eaf1-5872-4018-853e-8beca8d90ce7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:03.230688 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4499eaf1-5872-4018-853e-8beca8d90ce7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:03.231116 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4499eaf1-5872-4018-853e-8beca8d90ce7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1406 microversion: 2.20 time: 0.405901 Oct 13 04:18:03.231827 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 60/123] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:18:02 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:18:03.235849 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f4db8844-2c87-4c09-b32d-4a7912065948 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1318 microversion: 2.1 time: 0.335191 Oct 13 04:18:03.246608 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 64/124] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:02 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:18:03.838614 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2e1a66e4-6908-418a-bba8-1515f0bd39fa tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:03.839216 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-2e1a66e4-6908-418a-bba8-1515f0bd39fa tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:03.845303 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2e1a66e4-6908-418a-bba8-1515f0bd39fa tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:03.845784 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2e1a66e4-6908-418a-bba8-1515f0bd39fa tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:03.846612 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2e1a66e4-6908-418a-bba8-1515f0bd39fa tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:03.847034 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2e1a66e4-6908-418a-bba8-1515f0bd39fa tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:03.905323 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-765cb8df-0187-4421-bcdf-d30b533ce3fd tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:03.906476 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-765cb8df-0187-4421-bcdf-d30b533ce3fd tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:03.913042 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-765cb8df-0187-4421-bcdf-d30b533ce3fd tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:03.913778 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-765cb8df-0187-4421-bcdf-d30b533ce3fd tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:03.914979 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-765cb8df-0187-4421-bcdf-d30b533ce3fd tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:03.915488 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-765cb8df-0187-4421-bcdf-d30b533ce3fd tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:04.007025 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-2e1a66e4-6908-418a-bba8-1515f0bd39fa tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:04.014935 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-2e1a66e4-6908-418a-bba8-1515f0bd39fa tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1363 microversion: 2.1 time: 0.180095 Oct 13 04:18:04.015500 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 61/125] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:03 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:04.067252 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-765cb8df-0187-4421-bcdf-d30b533ce3fd tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:04.074895 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-765cb8df-0187-4421-bcdf-d30b533ce3fd tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1314 microversion: 2.1 time: 0.173112 Oct 13 04:18:04.075509 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 65/126] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:03 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:04.247985 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-dd4719bb-9bb5-43ad-be4b-f410690bd002 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:04.248539 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-dd4719bb-9bb5-43ad-be4b-f410690bd002 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:04.254055 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b09a5938-5c98-491b-b3ce-b243d3040d66 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:04.254633 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b09a5938-5c98-491b-b3ce-b243d3040d66 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:04.257828 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dd4719bb-9bb5-43ad-be4b-f410690bd002 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:04.258150 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dd4719bb-9bb5-43ad-be4b-f410690bd002 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:04.259015 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dd4719bb-9bb5-43ad-be4b-f410690bd002 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:04.259443 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dd4719bb-9bb5-43ad-be4b-f410690bd002 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:04.261830 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b09a5938-5c98-491b-b3ce-b243d3040d66 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:04.262494 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b09a5938-5c98-491b-b3ce-b243d3040d66 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:04.263796 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b09a5938-5c98-491b-b3ce-b243d3040d66 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:04.266513 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b09a5938-5c98-491b-b3ce-b243d3040d66 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:04.517772 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-dd4719bb-9bb5-43ad-be4b-f410690bd002 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:04.523715 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b09a5938-5c98-491b-b3ce-b243d3040d66 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:04.529157 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-dd4719bb-9bb5-43ad-be4b-f410690bd002 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:04.531745 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-dd4719bb-9bb5-43ad-be4b-f410690bd002 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:04.532296 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b09a5938-5c98-491b-b3ce-b243d3040d66 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1509 microversion: 2.1 time: 0.282412 Oct 13 04:18:04.532907 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-dd4719bb-9bb5-43ad-be4b-f410690bd002 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1406 microversion: 2.20 time: 0.288597 Oct 13 04:18:04.533576 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 62/127] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:18:04 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1406 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:18:04.545924 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 66/128] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:04 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1509 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:05.031782 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a7c33ea5-0313-4fa4-b277-d384d9dd65eb tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:05.032375 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a7c33ea5-0313-4fa4-b277-d384d9dd65eb tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:05.040121 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a7c33ea5-0313-4fa4-b277-d384d9dd65eb tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:05.040578 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a7c33ea5-0313-4fa4-b277-d384d9dd65eb tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:05.044299 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a7c33ea5-0313-4fa4-b277-d384d9dd65eb tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:05.044906 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a7c33ea5-0313-4fa4-b277-d384d9dd65eb tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:05.092472 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-78ea3383-2879-45df-9938-56485545f2af tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:05.093333 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-78ea3383-2879-45df-9938-56485545f2af tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:05.107338 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-78ea3383-2879-45df-9938-56485545f2af tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:05.107875 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-78ea3383-2879-45df-9938-56485545f2af tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:05.108718 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-78ea3383-2879-45df-9938-56485545f2af tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:05.109206 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-78ea3383-2879-45df-9938-56485545f2af tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:05.219265 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a7c33ea5-0313-4fa4-b277-d384d9dd65eb tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:05.226574 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a7c33ea5-0313-4fa4-b277-d384d9dd65eb tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1363 microversion: 2.1 time: 0.198422 Oct 13 04:18:05.227208 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 63/129] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:05 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:05.278869 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-78ea3383-2879-45df-9938-56485545f2af tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:05.286440 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-78ea3383-2879-45df-9938-56485545f2af tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1501 microversion: 2.1 time: 0.197934 Oct 13 04:18:05.287073 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 67/130] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:05 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1501 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:18:05.554195 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-dce50124-c604-4907-82b9-3e2014297325 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:05.554195 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-dce50124-c604-4907-82b9-3e2014297325 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:05.564063 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dce50124-c604-4907-82b9-3e2014297325 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:05.566535 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dce50124-c604-4907-82b9-3e2014297325 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:05.567750 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dce50124-c604-4907-82b9-3e2014297325 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:05.568493 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dce50124-c604-4907-82b9-3e2014297325 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:05.763295 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-dce50124-c604-4907-82b9-3e2014297325 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:05.772960 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-dce50124-c604-4907-82b9-3e2014297325 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:05.775161 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-dce50124-c604-4907-82b9-3e2014297325 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:05.776273 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-dce50124-c604-4907-82b9-3e2014297325 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1406 microversion: 2.20 time: 0.228717 Oct 13 04:18:05.776968 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 64/131] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:18:05 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:18:06.242725 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c83602ea-f2f4-4c71-b5de-9951c1d1bf48 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:06.243418 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c83602ea-f2f4-4c71-b5de-9951c1d1bf48 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:06.248933 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c83602ea-f2f4-4c71-b5de-9951c1d1bf48 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:06.249360 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c83602ea-f2f4-4c71-b5de-9951c1d1bf48 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:06.250323 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c83602ea-f2f4-4c71-b5de-9951c1d1bf48 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:06.250911 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c83602ea-f2f4-4c71-b5de-9951c1d1bf48 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:06.386334 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c83602ea-f2f4-4c71-b5de-9951c1d1bf48 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:06.393568 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c83602ea-f2f4-4c71-b5de-9951c1d1bf48 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1363 microversion: 2.1 time: 0.154537 Oct 13 04:18:06.394501 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 68/132] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:06 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:06.654958 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-9053546d-03ae-4945-a7c3-1fc9f8016048 req-e32695a8-54ca-41b3-8771-633269915260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c2b8a8f-db02-4581-b497-1f4caa68240f", "name": "network-vif-plugged", "status": "completed", "tag": "819b5060-2257-431d-a719-93e3e23c273c"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:06.656531 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:18:06.656531 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:18:06.665497 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-9053546d-03ae-4945-a7c3-1fc9f8016048 req-e32695a8-54ca-41b3-8771-633269915260 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:06.666201 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-9053546d-03ae-4945-a7c3-1fc9f8016048 req-e32695a8-54ca-41b3-8771-633269915260 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:06.678772 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-9053546d-03ae-4945-a7c3-1fc9f8016048 req-e32695a8-54ca-41b3-8771-633269915260 service nova] Creating event network-vif-plugged:819b5060-2257-431d-a719-93e3e23c273c for instance 3c2b8a8f-db02-4581-b497-1f4caa68240f on hv-cinder-81275 Oct 13 04:18:06.686542 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-9053546d-03ae-4945-a7c3-1fc9f8016048 req-e32695a8-54ca-41b3-8771-633269915260 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034376 Oct 13 04:18:06.687222 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 65/133] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:18:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:18:06.794291 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-55b38828-baf6-43f6-9139-f043b84a6764 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:06.795098 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-55b38828-baf6-43f6-9139-f043b84a6764 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:06.802694 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-55b38828-baf6-43f6-9139-f043b84a6764 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:06.807044 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-55b38828-baf6-43f6-9139-f043b84a6764 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:06.808172 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-55b38828-baf6-43f6-9139-f043b84a6764 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:06.809575 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-55b38828-baf6-43f6-9139-f043b84a6764 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:06.979839 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-55b38828-baf6-43f6-9139-f043b84a6764 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:06.989693 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-55b38828-baf6-43f6-9139-f043b84a6764 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:06.992324 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-55b38828-baf6-43f6-9139-f043b84a6764 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:06.994421 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-55b38828-baf6-43f6-9139-f043b84a6764 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1406 microversion: 2.20 time: 0.203356 Oct 13 04:18:07.005723 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 69/134] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:18:06 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:18:07.412472 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-38ff50d1-eca6-4e92-95d6-5b0fc0aa8803 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:07.412472 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-38ff50d1-eca6-4e92-95d6-5b0fc0aa8803 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:07.419260 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-38ff50d1-eca6-4e92-95d6-5b0fc0aa8803 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:07.419703 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-38ff50d1-eca6-4e92-95d6-5b0fc0aa8803 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:07.420460 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-38ff50d1-eca6-4e92-95d6-5b0fc0aa8803 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:07.421147 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-38ff50d1-eca6-4e92-95d6-5b0fc0aa8803 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:07.566525 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-38ff50d1-eca6-4e92-95d6-5b0fc0aa8803 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:07.574080 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-38ff50d1-eca6-4e92-95d6-5b0fc0aa8803 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1363 microversion: 2.1 time: 0.167145 Oct 13 04:18:07.581687 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 66/135] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:07 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:08.017029 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a6c8e53a-a98b-4767-9757-d2d1dcbf336f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:08.017786 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a6c8e53a-a98b-4767-9757-d2d1dcbf336f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:08.026578 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a6c8e53a-a98b-4767-9757-d2d1dcbf336f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:08.027269 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a6c8e53a-a98b-4767-9757-d2d1dcbf336f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:08.028724 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a6c8e53a-a98b-4767-9757-d2d1dcbf336f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:08.029141 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a6c8e53a-a98b-4767-9757-d2d1dcbf336f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:08.208335 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a6c8e53a-a98b-4767-9757-d2d1dcbf336f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:08.216632 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a6c8e53a-a98b-4767-9757-d2d1dcbf336f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:08.218148 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a6c8e53a-a98b-4767-9757-d2d1dcbf336f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:08.219247 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a6c8e53a-a98b-4767-9757-d2d1dcbf336f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1406 microversion: 2.20 time: 0.206488 Oct 13 04:18:08.230036 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 70/136] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:18:08 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:18:08.591321 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4832f99f-0982-4da1-b047-f831f63fe624 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:08.592189 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4832f99f-0982-4da1-b047-f831f63fe624 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:08.598126 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4832f99f-0982-4da1-b047-f831f63fe624 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:08.598972 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4832f99f-0982-4da1-b047-f831f63fe624 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:08.599811 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4832f99f-0982-4da1-b047-f831f63fe624 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:08.600320 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4832f99f-0982-4da1-b047-f831f63fe624 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:08.721997 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-95d866ec-e606-4aec-ac95-83ebd4c6aa30 req-7c7a0f3d-8c07-495f-8d5d-ca328187a8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a527ca0-f4d9-4478-8737-56edd7fe83fc", "name": "network-vif-plugged", "status": "completed", "tag": "2bf8b44d-dd7e-4a64-bef6-74e34e11e05f"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:08.724059 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:18:08.724059 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:18:08.731963 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-95d866ec-e606-4aec-ac95-83ebd4c6aa30 req-7c7a0f3d-8c07-495f-8d5d-ca328187a8b8 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:08.732558 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-95d866ec-e606-4aec-ac95-83ebd4c6aa30 req-7c7a0f3d-8c07-495f-8d5d-ca328187a8b8 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:08.751251 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4832f99f-0982-4da1-b047-f831f63fe624 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:08.753752 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-95d866ec-e606-4aec-ac95-83ebd4c6aa30 req-7c7a0f3d-8c07-495f-8d5d-ca328187a8b8 service nova] Creating event network-vif-plugged:2bf8b44d-dd7e-4a64-bef6-74e34e11e05f for instance 6a527ca0-f4d9-4478-8737-56edd7fe83fc on hv-cinder-81275 Oct 13 04:18:08.761130 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-95d866ec-e606-4aec-ac95-83ebd4c6aa30 req-7c7a0f3d-8c07-495f-8d5d-ca328187a8b8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043405 Oct 13 04:18:08.762180 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 71/137] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:18:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:18:08.773802 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4832f99f-0982-4da1-b047-f831f63fe624 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1363 microversion: 2.1 time: 0.186168 Oct 13 04:18:08.775113 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 67/138] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:08 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:09.239302 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-bf65c850-5f18-4861-87a4-5d9827aa457f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:09.239302 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-bf65c850-5f18-4861-87a4-5d9827aa457f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:09.244970 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bf65c850-5f18-4861-87a4-5d9827aa457f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:09.245421 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bf65c850-5f18-4861-87a4-5d9827aa457f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:09.246222 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bf65c850-5f18-4861-87a4-5d9827aa457f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:09.246798 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bf65c850-5f18-4861-87a4-5d9827aa457f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:09.375545 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-bf65c850-5f18-4861-87a4-5d9827aa457f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:09.383407 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-bf65c850-5f18-4861-87a4-5d9827aa457f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:09.384852 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-bf65c850-5f18-4861-87a4-5d9827aa457f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:09.385985 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-bf65c850-5f18-4861-87a4-5d9827aa457f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1406 microversion: 2.20 time: 0.152502 Oct 13 04:18:09.386570 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 72/139] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:18:09 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:18:09.790819 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f138b64d-7db2-46ca-b2a1-5a6118068404 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:09.792128 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f138b64d-7db2-46ca-b2a1-5a6118068404 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:09.802358 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f138b64d-7db2-46ca-b2a1-5a6118068404 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:09.802791 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f138b64d-7db2-46ca-b2a1-5a6118068404 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:09.803540 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f138b64d-7db2-46ca-b2a1-5a6118068404 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:09.803952 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f138b64d-7db2-46ca-b2a1-5a6118068404 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:09.942464 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f138b64d-7db2-46ca-b2a1-5a6118068404 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:09.949921 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f138b64d-7db2-46ca-b2a1-5a6118068404 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1363 microversion: 2.1 time: 0.163012 Oct 13 04:18:09.950582 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 68/140] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:09 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:10.403754 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-20b2e5ea-e1d1-4f77-9d9f-7408d2f7feb0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:10.404361 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-20b2e5ea-e1d1-4f77-9d9f-7408d2f7feb0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:10.413625 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-20b2e5ea-e1d1-4f77-9d9f-7408d2f7feb0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:10.414076 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-20b2e5ea-e1d1-4f77-9d9f-7408d2f7feb0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:10.415413 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-20b2e5ea-e1d1-4f77-9d9f-7408d2f7feb0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:10.415986 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-20b2e5ea-e1d1-4f77-9d9f-7408d2f7feb0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:10.542973 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-20b2e5ea-e1d1-4f77-9d9f-7408d2f7feb0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:10.550893 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-20b2e5ea-e1d1-4f77-9d9f-7408d2f7feb0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:10.552532 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-20b2e5ea-e1d1-4f77-9d9f-7408d2f7feb0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:10.553921 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-20b2e5ea-e1d1-4f77-9d9f-7408d2f7feb0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1406 microversion: 2.20 time: 0.153738 Oct 13 04:18:10.554487 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 73/141] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:18:10 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:18:10.966566 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3ad6d49b-35ae-458f-b5f8-d18b09230a8d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:10.967199 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3ad6d49b-35ae-458f-b5f8-d18b09230a8d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:10.973226 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3ad6d49b-35ae-458f-b5f8-d18b09230a8d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:10.973688 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3ad6d49b-35ae-458f-b5f8-d18b09230a8d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:10.974530 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3ad6d49b-35ae-458f-b5f8-d18b09230a8d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:10.974895 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3ad6d49b-35ae-458f-b5f8-d18b09230a8d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:11.097298 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-3ad6d49b-35ae-458f-b5f8-d18b09230a8d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:11.106425 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3ad6d49b-35ae-458f-b5f8-d18b09230a8d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1363 microversion: 2.1 time: 0.143425 Oct 13 04:18:11.108087 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 69/142] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:10 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:11.417260 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7e9d26c4-0693-48f4-9367-e08bca53f761 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "231ec7ad-c1c8-441a-987d-d19357a59200"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:11.418340 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7e9d26c4-0693-48f4-9367-e08bca53f761 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:11.424137 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7e9d26c4-0693-48f4-9367-e08bca53f761 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:11.424565 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7e9d26c4-0693-48f4-9367-e08bca53f761 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:11.425335 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7e9d26c4-0693-48f4-9367-e08bca53f761 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:11.425780 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7e9d26c4-0693-48f4-9367-e08bca53f761 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:11.571806 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1d30b707-a0f7-4b73-85a4-d36d090c13a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:11.572405 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-1d30b707-a0f7-4b73-85a4-d36d090c13a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:11.579493 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1d30b707-a0f7-4b73-85a4-d36d090c13a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:11.579919 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1d30b707-a0f7-4b73-85a4-d36d090c13a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:11.580665 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1d30b707-a0f7-4b73-85a4-d36d090c13a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:11.581078 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1d30b707-a0f7-4b73-85a4-d36d090c13a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:11.716048 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-1d30b707-a0f7-4b73-85a4-d36d090c13a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:11.724006 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-1d30b707-a0f7-4b73-85a4-d36d090c13a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:11.725474 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-1d30b707-a0f7-4b73-85a4-d36d090c13a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:11.726916 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-1d30b707-a0f7-4b73-85a4-d36d090c13a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1597 microversion: 2.20 time: 0.158851 Oct 13 04:18:11.727471 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 70/143] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:18:11 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1597 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:18:11.745264 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b3472196-561e-4847-981e-aea9511b21a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:11.745822 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b3472196-561e-4847-981e-aea9511b21a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:11.752995 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b3472196-561e-4847-981e-aea9511b21a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:11.753514 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b3472196-561e-4847-981e-aea9511b21a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:11.754370 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b3472196-561e-4847-981e-aea9511b21a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:11.754864 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b3472196-561e-4847-981e-aea9511b21a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:11.807882 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7e9d26c4-0693-48f4-9367-e08bca53f761 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "POST /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.394558 Oct 13 04:18:11.808489 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 74/144] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Oct 13 04:18:11 2021] POST /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:18:11.880378 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b3472196-561e-4847-981e-aea9511b21a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.139263 Oct 13 04:18:11.880969 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 71/145] 10.222.0.55 () {60 vars in 1315 bytes} [Wed Oct 13 04:18:11 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:18:11.952838 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1adef7d8-5c13-4531-981a-3dc537e2c932 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e364855f-aed1-4866-adb3-34310b8360b4"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:11.953974 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1adef7d8-5c13-4531-981a-3dc537e2c932 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:11.962701 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1adef7d8-5c13-4531-981a-3dc537e2c932 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:11.963125 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1adef7d8-5c13-4531-981a-3dc537e2c932 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:11.964065 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1adef7d8-5c13-4531-981a-3dc537e2c932 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:11.964604 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1adef7d8-5c13-4531-981a-3dc537e2c932 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:12.124342 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d215aa10-9883-410b-9089-01e970987e7d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:12.124960 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d215aa10-9883-410b-9089-01e970987e7d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:12.131437 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d215aa10-9883-410b-9089-01e970987e7d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:12.131897 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d215aa10-9883-410b-9089-01e970987e7d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:12.132688 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d215aa10-9883-410b-9089-01e970987e7d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:12.133119 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d215aa10-9883-410b-9089-01e970987e7d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:12.255270 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d215aa10-9883-410b-9089-01e970987e7d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:12.262710 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d215aa10-9883-410b-9089-01e970987e7d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1363 microversion: 2.1 time: 0.142099 Oct 13 04:18:12.263279 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 72/146] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:12 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:13.241283 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-498ec577-2dd7-46ab-9ae2-f8d6ac40eab5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:13.242266 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-498ec577-2dd7-46ab-9ae2-f8d6ac40eab5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:13.249000 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-498ec577-2dd7-46ab-9ae2-f8d6ac40eab5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:13.249447 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-498ec577-2dd7-46ab-9ae2-f8d6ac40eab5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:13.250236 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-498ec577-2dd7-46ab-9ae2-f8d6ac40eab5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:13.250664 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-498ec577-2dd7-46ab-9ae2-f8d6ac40eab5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:17.464392 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-498ec577-2dd7-46ab-9ae2-f8d6ac40eab5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 14 microversion: 2.20 time: 4.226739 Oct 13 04:18:17.466249 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 73/147] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:13 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 14 bytes in 4230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:18:17.472596 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-4c84bae5-4824-40a7-ba6e-55f88393253c req-ab46795f-0e1f-416a-b77e-fe02b127f9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c2b8a8f-db02-4581-b497-1f4caa68240f", "tag": "819b5060-2257-431d-a719-93e3e23c273c"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:17.474122 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:18:17.474122 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:18:17.483631 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-4c84bae5-4824-40a7-ba6e-55f88393253c req-ab46795f-0e1f-416a-b77e-fe02b127f9a8 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:17.484070 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-4c84bae5-4824-40a7-ba6e-55f88393253c req-ab46795f-0e1f-416a-b77e-fe02b127f9a8 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:17.495758 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-4c84bae5-4824-40a7-ba6e-55f88393253c req-ab46795f-0e1f-416a-b77e-fe02b127f9a8 service nova] Creating event network-changed:819b5060-2257-431d-a719-93e3e23c273c for instance 3c2b8a8f-db02-4581-b497-1f4caa68240f on hv-cinder-81275 Oct 13 04:18:17.501211 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-4c84bae5-4824-40a7-ba6e-55f88393253c req-ab46795f-0e1f-416a-b77e-fe02b127f9a8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033296 Oct 13 04:18:17.502035 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 74/148] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:18:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:18:17.506991 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f8018fca-5517-427f-9158-7e549b336f91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:17.507674 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f8018fca-5517-427f-9158-7e549b336f91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:17.514146 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f8018fca-5517-427f-9158-7e549b336f91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:17.514582 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f8018fca-5517-427f-9158-7e549b336f91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:17.515338 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f8018fca-5517-427f-9158-7e549b336f91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:17.515760 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f8018fca-5517-427f-9158-7e549b336f91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:17.687101 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1adef7d8-5c13-4531-981a-3dc537e2c932 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "POST /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.738342 Oct 13 04:18:17.688047 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 75/149] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Oct 13 04:18:11 2021] POST /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f/os-volume_attachments => generated 194 bytes in 5740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:18:17.694937 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f8018fca-5517-427f-9158-7e549b336f91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:17.702573 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f8018fca-5517-427f-9158-7e549b336f91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1549 microversion: 2.1 time: 0.199361 Oct 13 04:18:17.703137 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 75/150] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:17 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1549 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:17.720244 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-6551a463-d153-4ac5-9771-f238ff6423ba tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:17.720817 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-6551a463-d153-4ac5-9771-f238ff6423ba tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:17.726798 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6551a463-d153-4ac5-9771-f238ff6423ba tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:17.727398 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6551a463-d153-4ac5-9771-f238ff6423ba tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:17.728159 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6551a463-d153-4ac5-9771-f238ff6423ba tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:17.728587 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6551a463-d153-4ac5-9771-f238ff6423ba tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:17.807385 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-6551a463-d153-4ac5-9771-f238ff6423ba tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091154 Oct 13 04:18:17.807994 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 76/151] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Oct 13 04:18:17 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:18:18.476939 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4a426be0-ee37-4799-b991-136e560c72e0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:18.477980 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4a426be0-ee37-4799-b991-136e560c72e0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:18.484801 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4a426be0-ee37-4799-b991-136e560c72e0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:18.485233 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4a426be0-ee37-4799-b991-136e560c72e0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:18.486036 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4a426be0-ee37-4799-b991-136e560c72e0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:18.486457 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4a426be0-ee37-4799-b991-136e560c72e0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:18.564590 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4a426be0-ee37-4799-b991-136e560c72e0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 14 microversion: 2.20 time: 0.091382 Oct 13 04:18:18.565304 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 76/152] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:18 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:19.540192 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-959336bc-e654-41cf-b261-dfb69730e2f3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:19.541332 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-959336bc-e654-41cf-b261-dfb69730e2f3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:19.545802 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-6f9e2732-90d4-479b-88c1-a1ff1315af73 req-79a2d811-7168-433c-a644-4ceca58dfc7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a527ca0-f4d9-4478-8737-56edd7fe83fc", "tag": "2bf8b44d-dd7e-4a64-bef6-74e34e11e05f"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:19.548476 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:18:19.548476 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:18:19.548873 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-959336bc-e654-41cf-b261-dfb69730e2f3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:19.549807 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-959336bc-e654-41cf-b261-dfb69730e2f3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:19.551569 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-959336bc-e654-41cf-b261-dfb69730e2f3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:19.552712 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-959336bc-e654-41cf-b261-dfb69730e2f3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:19.558496 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-6f9e2732-90d4-479b-88c1-a1ff1315af73 req-79a2d811-7168-433c-a644-4ceca58dfc7e service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:19.559063 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-6f9e2732-90d4-479b-88c1-a1ff1315af73 req-79a2d811-7168-433c-a644-4ceca58dfc7e service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:19.571100 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-6f9e2732-90d4-479b-88c1-a1ff1315af73 req-79a2d811-7168-433c-a644-4ceca58dfc7e service nova] Creating event network-changed:2bf8b44d-dd7e-4a64-bef6-74e34e11e05f for instance 6a527ca0-f4d9-4478-8737-56edd7fe83fc on hv-cinder-81275 Oct 13 04:18:19.576177 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-6f9e2732-90d4-479b-88c1-a1ff1315af73 req-79a2d811-7168-433c-a644-4ceca58dfc7e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034524 Oct 13 04:18:19.577332 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 77/153] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:18:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:18:19.583283 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6de489b5-06a7-4718-af3a-0f23802e4084 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:19.584350 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6de489b5-06a7-4718-af3a-0f23802e4084 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:19.590445 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6de489b5-06a7-4718-af3a-0f23802e4084 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:19.591192 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6de489b5-06a7-4718-af3a-0f23802e4084 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:19.592031 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6de489b5-06a7-4718-af3a-0f23802e4084 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:19.592445 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6de489b5-06a7-4718-af3a-0f23802e4084 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:19.677528 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-959336bc-e654-41cf-b261-dfb69730e2f3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 14 microversion: 2.1 time: 0.142306 Oct 13 04:18:19.678414 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 77/154] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:19 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:18:19.683777 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6de489b5-06a7-4718-af3a-0f23802e4084 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 14 microversion: 2.20 time: 0.104831 Oct 13 04:18:19.684667 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 78/155] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:19 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:20.695111 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c7566350-d4d9-4657-9cb7-a87c5588ad23 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:20.695972 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c7566350-d4d9-4657-9cb7-a87c5588ad23 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:20.703664 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-350db9d0-66ea-45ed-94bb-fa102865f853 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:20.704657 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-350db9d0-66ea-45ed-94bb-fa102865f853 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:20.704886 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c7566350-d4d9-4657-9cb7-a87c5588ad23 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:20.707433 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c7566350-d4d9-4657-9cb7-a87c5588ad23 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:20.708415 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c7566350-d4d9-4657-9cb7-a87c5588ad23 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:20.709030 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c7566350-d4d9-4657-9cb7-a87c5588ad23 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:20.717023 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-350db9d0-66ea-45ed-94bb-fa102865f853 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:20.717474 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-350db9d0-66ea-45ed-94bb-fa102865f853 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:20.718295 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-350db9d0-66ea-45ed-94bb-fa102865f853 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:20.719911 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-350db9d0-66ea-45ed-94bb-fa102865f853 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:20.811064 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c7566350-d4d9-4657-9cb7-a87c5588ad23 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 14 microversion: 2.20 time: 0.119941 Oct 13 04:18:20.811980 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 79/156] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:20 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:18:20.817754 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-350db9d0-66ea-45ed-94bb-fa102865f853 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 14 microversion: 2.1 time: 0.131337 Oct 13 04:18:20.821532 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 78/157] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:20 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:18:21.827309 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-295ee8bb-789a-446a-af9c-4802ea05643f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:21.829933 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-295ee8bb-789a-446a-af9c-4802ea05643f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:21.833549 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2b0abb7f-ac87-4653-877c-8c7c0eab4a0b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:21.835086 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2b0abb7f-ac87-4653-877c-8c7c0eab4a0b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:21.839680 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-295ee8bb-789a-446a-af9c-4802ea05643f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:21.840153 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-295ee8bb-789a-446a-af9c-4802ea05643f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:21.840910 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-295ee8bb-789a-446a-af9c-4802ea05643f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:21.841336 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-295ee8bb-789a-446a-af9c-4802ea05643f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:21.842646 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2b0abb7f-ac87-4653-877c-8c7c0eab4a0b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:21.843083 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2b0abb7f-ac87-4653-877c-8c7c0eab4a0b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:21.843825 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2b0abb7f-ac87-4653-877c-8c7c0eab4a0b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:21.844243 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2b0abb7f-ac87-4653-877c-8c7c0eab4a0b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:21.917337 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-295ee8bb-789a-446a-af9c-4802ea05643f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 14 microversion: 2.20 time: 0.096743 Oct 13 04:18:21.918030 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 80/158] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:21 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:21.920649 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2b0abb7f-ac87-4653-877c-8c7c0eab4a0b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 14 microversion: 2.1 time: 0.093848 Oct 13 04:18:21.921330 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 79/159] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:21 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:18:22.928909 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-41d4a670-8456-4f68-8b97-5ecdaa467277 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:22.933117 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-284ee8cf-67d5-4ab2-8583-2314e2c05060 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:22.933117 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-284ee8cf-67d5-4ab2-8583-2314e2c05060 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:22.933952 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-41d4a670-8456-4f68-8b97-5ecdaa467277 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:22.938544 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-284ee8cf-67d5-4ab2-8583-2314e2c05060 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:22.939171 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-284ee8cf-67d5-4ab2-8583-2314e2c05060 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:22.939922 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-284ee8cf-67d5-4ab2-8583-2314e2c05060 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:22.940342 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-284ee8cf-67d5-4ab2-8583-2314e2c05060 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:22.940821 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-41d4a670-8456-4f68-8b97-5ecdaa467277 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:22.941425 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-41d4a670-8456-4f68-8b97-5ecdaa467277 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:22.942215 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-41d4a670-8456-4f68-8b97-5ecdaa467277 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:22.945640 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-41d4a670-8456-4f68-8b97-5ecdaa467277 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:23.013503 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-284ee8cf-67d5-4ab2-8583-2314e2c05060 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 14 microversion: 2.1 time: 0.086195 Oct 13 04:18:23.014205 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 80/160] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:22 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:18:23.042794 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-41d4a670-8456-4f68-8b97-5ecdaa467277 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 14 microversion: 2.20 time: 0.117925 Oct 13 04:18:23.043822 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 81/161] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:22 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:18:24.024880 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a697516c-d570-46dc-997f-46985467c017 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:24.025953 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a697516c-d570-46dc-997f-46985467c017 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:24.032638 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a697516c-d570-46dc-997f-46985467c017 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:24.033125 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a697516c-d570-46dc-997f-46985467c017 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:24.034069 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a697516c-d570-46dc-997f-46985467c017 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:24.034297 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a697516c-d570-46dc-997f-46985467c017 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:24.054343 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-13de6bc0-94d3-48bf-97ec-4abe07064b8b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:24.055336 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-13de6bc0-94d3-48bf-97ec-4abe07064b8b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:24.061919 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-13de6bc0-94d3-48bf-97ec-4abe07064b8b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:24.062359 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-13de6bc0-94d3-48bf-97ec-4abe07064b8b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:24.063125 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-13de6bc0-94d3-48bf-97ec-4abe07064b8b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:24.063557 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-13de6bc0-94d3-48bf-97ec-4abe07064b8b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:24.134385 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a697516c-d570-46dc-997f-46985467c017 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 14 microversion: 2.1 time: 0.113288 Oct 13 04:18:24.135038 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 81/162] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:24 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:18:24.146329 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-13de6bc0-94d3-48bf-97ec-4abe07064b8b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 14 microversion: 2.20 time: 0.096110 Oct 13 04:18:24.147613 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 82/163] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:24 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:18:25.144785 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-74367e21-87fd-467a-ac2b-3b5567be1608 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:25.145825 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-74367e21-87fd-467a-ac2b-3b5567be1608 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:25.152228 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-74367e21-87fd-467a-ac2b-3b5567be1608 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:25.152667 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-74367e21-87fd-467a-ac2b-3b5567be1608 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:25.153431 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-74367e21-87fd-467a-ac2b-3b5567be1608 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:25.153860 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-74367e21-87fd-467a-ac2b-3b5567be1608 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:25.157325 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ddfee376-471a-467c-8b11-57759880c281 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:25.158468 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ddfee376-471a-467c-8b11-57759880c281 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:25.165801 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ddfee376-471a-467c-8b11-57759880c281 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:25.165801 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ddfee376-471a-467c-8b11-57759880c281 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:25.166529 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ddfee376-471a-467c-8b11-57759880c281 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:25.166953 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ddfee376-471a-467c-8b11-57759880c281 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:25.235943 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ddfee376-471a-467c-8b11-57759880c281 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 14 microversion: 2.20 time: 0.082671 Oct 13 04:18:25.236588 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 83/164] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:25 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:25.239853 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-74367e21-87fd-467a-ac2b-3b5567be1608 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 14 microversion: 2.1 time: 0.098505 Oct 13 04:18:25.240387 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 82/165] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:25 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:18:26.250228 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-525bbccf-c4c1-410c-938d-7ac24aa269c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:26.251448 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-525bbccf-c4c1-410c-938d-7ac24aa269c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:26.251584 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0352fc83-2b80-44c1-ba9f-ec432e69cca5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:26.252581 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0352fc83-2b80-44c1-ba9f-ec432e69cca5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:26.259267 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0352fc83-2b80-44c1-ba9f-ec432e69cca5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:26.259988 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0352fc83-2b80-44c1-ba9f-ec432e69cca5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:26.261701 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0352fc83-2b80-44c1-ba9f-ec432e69cca5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:26.262201 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0352fc83-2b80-44c1-ba9f-ec432e69cca5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:26.262593 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-525bbccf-c4c1-410c-938d-7ac24aa269c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:26.263040 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-525bbccf-c4c1-410c-938d-7ac24aa269c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:26.265188 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-525bbccf-c4c1-410c-938d-7ac24aa269c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:26.266470 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-525bbccf-c4c1-410c-938d-7ac24aa269c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:30.684598 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0352fc83-2b80-44c1-ba9f-ec432e69cca5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 14 microversion: 2.1 time: 4.436776 Oct 13 04:18:30.686311 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 83/166] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:26 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 14 bytes in 4440 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:18:30.691128 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-525bbccf-c4c1-410c-938d-7ac24aa269c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 14 microversion: 2.20 time: 4.447043 Oct 13 04:18:30.692671 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 84/167] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:26 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 14 bytes in 4450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:31.701733 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f875dbe0-f084-4051-88f8-131650fcbf03 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:31.702888 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f875dbe0-f084-4051-88f8-131650fcbf03 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:31.706065 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2eaecc74-e2e1-4bd5-aa11-738a2405683a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:31.707059 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-2eaecc74-e2e1-4bd5-aa11-738a2405683a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:31.710058 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f875dbe0-f084-4051-88f8-131650fcbf03 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:31.710503 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f875dbe0-f084-4051-88f8-131650fcbf03 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:31.711264 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f875dbe0-f084-4051-88f8-131650fcbf03 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:31.711688 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f875dbe0-f084-4051-88f8-131650fcbf03 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:31.713500 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2eaecc74-e2e1-4bd5-aa11-738a2405683a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:31.713983 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2eaecc74-e2e1-4bd5-aa11-738a2405683a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:31.714729 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2eaecc74-e2e1-4bd5-aa11-738a2405683a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:31.715211 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2eaecc74-e2e1-4bd5-aa11-738a2405683a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:36.858458 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f875dbe0-f084-4051-88f8-131650fcbf03 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 18083 microversion: 2.1 time: 5.162644 Oct 13 04:18:36.858994 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 84/168] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:31 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 18083 bytes in 5165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:18:36.873958 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-2eaecc74-e2e1-4bd5-aa11-738a2405683a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 18305 microversion: 2.20 time: 5.172017 Oct 13 04:18:36.874634 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 85/169] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:31 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 18305 bytes in 5174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:18:37.437444 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ee2fe31a-9abb-49de-aa54-6e5a34e8c5ef tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1619293179", "imageRef": "4f468f34-171a-4b6e-a0cd-2e4c6fcda23d", "flavorRef": "452", "networks": [{"uuid": "0d1ab067-7575-4c07-97ac-3bce9cca9c59"}]}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:37.490447 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.network.neutron [None req-ee2fe31a-9abb-49de-aa54-6e5a34e8c5ef tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] validate_networks() for [('0d1ab067-7575-4c07-97ac-3bce9cca9c59', None, None, None, None, None)] {{(pid=108259) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:18:37.868105 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-ee2fe31a-9abb-49de-aa54-6e5a34e8c5ef tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Flavor limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:18:37.868682 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-ee2fe31a-9abb-49de-aa54-6e5a34e8c5ef tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Image limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:18:37.868982 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-ee2fe31a-9abb-49de-aa54-6e5a34e8c5ef tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Flavor pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:18:37.869375 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-ee2fe31a-9abb-49de-aa54-6e5a34e8c5ef tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Image pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:18:37.869811 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-ee2fe31a-9abb-49de-aa54-6e5a34e8c5ef tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:18:37.871199 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-97b1fd10-10a2-4e2c-b56e-7beab181bd70 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:37.872223 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-97b1fd10-10a2-4e2c-b56e-7beab181bd70 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:37.878320 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ee2fe31a-9abb-49de-aa54-6e5a34e8c5ef tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:37.880319 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ee2fe31a-9abb-49de-aa54-6e5a34e8c5ef tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:37.880432 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-97b1fd10-10a2-4e2c-b56e-7beab181bd70 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:37.880432 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-97b1fd10-10a2-4e2c-b56e-7beab181bd70 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:37.880897 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ee2fe31a-9abb-49de-aa54-6e5a34e8c5ef tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:37.880897 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ee2fe31a-9abb-49de-aa54-6e5a34e8c5ef tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:37.881067 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-97b1fd10-10a2-4e2c-b56e-7beab181bd70 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:37.881067 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-97b1fd10-10a2-4e2c-b56e-7beab181bd70 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:37.895494 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-ee2fe31a-9abb-49de-aa54-6e5a34e8c5ef tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Getting quotas for project f6806325e2e94089a6944698ad9b7808. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:18:37.899428 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-ee2fe31a-9abb-49de-aa54-6e5a34e8c5ef tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Getting quotas for user 9d3f110a789d432d85e185decef26aea and project f6806325e2e94089a6944698ad9b7808. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:18:37.910713 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ee2fe31a-9abb-49de-aa54-6e5a34e8c5ef tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Going to run 1 instances... {{(pid=108259) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:18:37.913150 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ee2fe31a-9abb-49de-aa54-6e5a34e8c5ef tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f468f34-171a-4b6e-a0cd-2e4c6fcda23d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:18:37.959788 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ee2fe31a-9abb-49de-aa54-6e5a34e8c5ef tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526415 Oct 13 04:18:37.960413 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 85/170] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Oct 13 04:18:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 04:18:37.964970 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-226e12a2-8ab1-4d8a-a3f3-0820b987f378 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:37.966369 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-226e12a2-8ab1-4d8a-a3f3-0820b987f378 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:37.972593 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-226e12a2-8ab1-4d8a-a3f3-0820b987f378 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:37.973105 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-226e12a2-8ab1-4d8a-a3f3-0820b987f378 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:37.973959 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-226e12a2-8ab1-4d8a-a3f3-0820b987f378 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:37.974387 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-226e12a2-8ab1-4d8a-a3f3-0820b987f378 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:38.005349 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-97b1fd10-10a2-4e2c-b56e-7beab181bd70 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 19342 microversion: 2.1 time: 0.137146 Oct 13 04:18:38.006209 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 86/171] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:37 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 19342 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:18:38.011852 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-32576d40-2d1c-4451-8038-f4a8c3e59e77 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:38.012785 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-32576d40-2d1c-4451-8038-f4a8c3e59e77 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:38.067987 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-32576d40-2d1c-4451-8038-f4a8c3e59e77 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:38.070184 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-226e12a2-8ab1-4d8a-a3f3-0820b987f378 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 19342 microversion: 2.20 time: 0.108514 Oct 13 04:18:38.074686 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 86/172] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:37 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 19342 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:18:38.078652 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-32576d40-2d1c-4451-8038-f4a8c3e59e77 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1218 microversion: 2.1 time: 0.070936 Oct 13 04:18:38.079264 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 87/173] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:38 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:39.017649 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-02d24593-f657-4d48-82be-4e9f8a3226e6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:39.018670 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-02d24593-f657-4d48-82be-4e9f8a3226e6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:39.025495 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-02d24593-f657-4d48-82be-4e9f8a3226e6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:39.025985 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-02d24593-f657-4d48-82be-4e9f8a3226e6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:39.026716 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-02d24593-f657-4d48-82be-4e9f8a3226e6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:39.027132 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-02d24593-f657-4d48-82be-4e9f8a3226e6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:39.082224 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-22774e12-2148-4686-9335-ffa44287faa1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:39.083370 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-22774e12-2148-4686-9335-ffa44287faa1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:39.091056 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-22774e12-2148-4686-9335-ffa44287faa1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:39.091484 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-22774e12-2148-4686-9335-ffa44287faa1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:39.092455 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-22774e12-2148-4686-9335-ffa44287faa1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:39.093134 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-22774e12-2148-4686-9335-ffa44287faa1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:39.103325 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-02d24593-f657-4d48-82be-4e9f8a3226e6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 21564 microversion: 2.1 time: 0.088935 Oct 13 04:18:39.104072 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 87/174] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:39 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 21564 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:18:39.109835 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3dc15fa9-73ce-462d-89f3-5a3c95b3c427 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:39.110540 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3dc15fa9-73ce-462d-89f3-5a3c95b3c427 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:39.118675 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3dc15fa9-73ce-462d-89f3-5a3c95b3c427 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:39.121167 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3dc15fa9-73ce-462d-89f3-5a3c95b3c427 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:39.122158 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3dc15fa9-73ce-462d-89f3-5a3c95b3c427 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:39.122802 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3dc15fa9-73ce-462d-89f3-5a3c95b3c427 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:39.201571 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-22774e12-2148-4686-9335-ffa44287faa1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 21513 microversion: 2.20 time: 0.122932 Oct 13 04:18:39.202241 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 88/175] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:39 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 21513 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:18:39.212705 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-3dc15fa9-73ce-462d-89f3-5a3c95b3c427 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:39.223201 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3dc15fa9-73ce-462d-89f3-5a3c95b3c427 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1276 microversion: 2.1 time: 0.117794 Oct 13 04:18:39.230274 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 88/176] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:39 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1276 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:39.261139 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-8c8d25b8-a0e7-4e3c-8831-adf269401440 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-966743251", "imageRef": "4f468f34-171a-4b6e-a0cd-2e4c6fcda23d", "flavorRef": "452", "networks": [{"uuid": "37641152-c7d0-4e3b-b8b6-cb9f4932709d"}]}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:39.312175 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.network.neutron [None req-8c8d25b8-a0e7-4e3c-8831-adf269401440 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] validate_networks() for [('37641152-c7d0-4e3b-b8b6-cb9f4932709d', None, None, None, None, None)] {{(pid=108260) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:18:39.817590 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-8c8d25b8-a0e7-4e3c-8831-adf269401440 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Flavor limits 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:18:39.818052 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-8c8d25b8-a0e7-4e3c-8831-adf269401440 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Image limits 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:18:39.818513 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-8c8d25b8-a0e7-4e3c-8831-adf269401440 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Flavor pref 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:18:39.818906 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-8c8d25b8-a0e7-4e3c-8831-adf269401440 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Image pref 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:18:39.819315 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-8c8d25b8-a0e7-4e3c-8831-adf269401440 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:18:39.828054 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8c8d25b8-a0e7-4e3c-8831-adf269401440 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:39.828487 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8c8d25b8-a0e7-4e3c-8831-adf269401440 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:39.829256 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8c8d25b8-a0e7-4e3c-8831-adf269401440 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:39.829701 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8c8d25b8-a0e7-4e3c-8831-adf269401440 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:39.845383 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-8c8d25b8-a0e7-4e3c-8831-adf269401440 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Getting quotas for project 09d2cdcae4c64be48feb38880725cda1. Resources: {'ram', 'cores', 'instances'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:18:39.849242 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-8c8d25b8-a0e7-4e3c-8831-adf269401440 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Getting quotas for user 6739d1337a744567827491ebc371f05f and project 09d2cdcae4c64be48feb38880725cda1. Resources: {'ram', 'cores', 'instances'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:18:39.867322 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-8c8d25b8-a0e7-4e3c-8831-adf269401440 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Going to run 1 instances... {{(pid=108260) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:18:39.869783 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-8c8d25b8-a0e7-4e3c-8831-adf269401440 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f468f34-171a-4b6e-a0cd-2e4c6fcda23d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:18:39.918562 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-8c8d25b8-a0e7-4e3c-8831-adf269401440 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661402 Oct 13 04:18:39.919338 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 89/177] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Oct 13 04:18:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 04:18:39.929031 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f1125c12-a1d5-4d70-86b7-600e83972f24 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:39.929655 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f1125c12-a1d5-4d70-86b7-600e83972f24 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:39.980070 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f1125c12-a1d5-4d70-86b7-600e83972f24 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:39.986596 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f1125c12-a1d5-4d70-86b7-600e83972f24 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1213 microversion: 2.1 time: 0.061214 Oct 13 04:18:39.987124 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 89/178] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:39 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1213 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:40.115143 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-0c43ccae-3b9d-432b-86a1-9801152e5921 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:40.116231 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-0c43ccae-3b9d-432b-86a1-9801152e5921 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:40.122849 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0c43ccae-3b9d-432b-86a1-9801152e5921 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:40.123581 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0c43ccae-3b9d-432b-86a1-9801152e5921 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:40.124279 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0c43ccae-3b9d-432b-86a1-9801152e5921 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:40.124790 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0c43ccae-3b9d-432b-86a1-9801152e5921 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:40.223064 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f4a2a8bd-359a-4455-bb90-c8e4b714e128 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:40.224116 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f4a2a8bd-359a-4455-bb90-c8e4b714e128 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:40.231837 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f4a2a8bd-359a-4455-bb90-c8e4b714e128 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:40.232278 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f4a2a8bd-359a-4455-bb90-c8e4b714e128 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:40.233041 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f4a2a8bd-359a-4455-bb90-c8e4b714e128 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:40.233663 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f4a2a8bd-359a-4455-bb90-c8e4b714e128 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:44.467531 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-0c43ccae-3b9d-432b-86a1-9801152e5921 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 25238 microversion: 2.1 time: 4.355989 Oct 13 04:18:44.468231 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 90/179] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:40 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 25238 bytes in 4358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:18:44.473190 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-fc01e70f-cf05-4c0f-a381-d42b083b526a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:44.473895 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-fc01e70f-cf05-4c0f-a381-d42b083b526a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:44.482042 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fc01e70f-cf05-4c0f-a381-d42b083b526a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:44.482618 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fc01e70f-cf05-4c0f-a381-d42b083b526a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:44.483484 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fc01e70f-cf05-4c0f-a381-d42b083b526a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:44.484035 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fc01e70f-cf05-4c0f-a381-d42b083b526a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:44.553880 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f4a2a8bd-359a-4455-bb90-c8e4b714e128 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 26739 microversion: 2.20 time: 4.343814 Oct 13 04:18:44.555074 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 90/180] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:40 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 26739 bytes in 4346 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:18:44.561088 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-1bf76f07-7b33-448b-a241-d1d142a0a478 req-26f94afd-25ff-47be-9122-fc81ab554a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5", "tag": "0873d595-38af-475f-97a0-d07dd43fbdb5"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:44.562794 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:18:44.562794 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:18:44.569967 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-1bf76f07-7b33-448b-a241-d1d142a0a478 req-26f94afd-25ff-47be-9122-fc81ab554a67 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:44.570382 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-1bf76f07-7b33-448b-a241-d1d142a0a478 req-26f94afd-25ff-47be-9122-fc81ab554a67 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:44.582337 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-1bf76f07-7b33-448b-a241-d1d142a0a478 req-26f94afd-25ff-47be-9122-fc81ab554a67 service nova] Creating event network-changed:0873d595-38af-475f-97a0-d07dd43fbdb5 for instance f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 on hv-cinder-81275 Oct 13 04:18:44.587281 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-1bf76f07-7b33-448b-a241-d1d142a0a478 req-26f94afd-25ff-47be-9122-fc81ab554a67 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030742 Oct 13 04:18:44.588305 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 91/181] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:18:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:18:44.593920 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-703b9830-13e8-4081-b3bc-d0e48e63db4b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:44.594741 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-703b9830-13e8-4081-b3bc-d0e48e63db4b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:44.601660 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-703b9830-13e8-4081-b3bc-d0e48e63db4b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:44.601916 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-703b9830-13e8-4081-b3bc-d0e48e63db4b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:44.602755 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-703b9830-13e8-4081-b3bc-d0e48e63db4b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:44.603270 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-703b9830-13e8-4081-b3bc-d0e48e63db4b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:44.719152 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-fc01e70f-cf05-4c0f-a381-d42b083b526a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:44.719552 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-703b9830-13e8-4081-b3bc-d0e48e63db4b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:44.727175 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-703b9830-13e8-4081-b3bc-d0e48e63db4b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1209 microversion: 2.1 time: 0.137705 Oct 13 04:18:44.728129 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 92/182] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:44 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1209 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:44.728808 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-fc01e70f-cf05-4c0f-a381-d42b083b526a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1318 microversion: 2.1 time: 0.259364 Oct 13 04:18:44.729381 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 91/183] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:44 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:45.480199 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5a280046-a92c-4b34-af56-02f121df62bf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:45.481177 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-5a280046-a92c-4b34-af56-02f121df62bf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:45.487050 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5a280046-a92c-4b34-af56-02f121df62bf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:45.487490 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5a280046-a92c-4b34-af56-02f121df62bf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:45.488240 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5a280046-a92c-4b34-af56-02f121df62bf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:45.488664 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5a280046-a92c-4b34-af56-02f121df62bf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:45.566268 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5827a815-dd50-45bd-95b4-4e9daa259b37 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:45.567222 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5827a815-dd50-45bd-95b4-4e9daa259b37 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:45.573737 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5827a815-dd50-45bd-95b4-4e9daa259b37 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:45.574205 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5827a815-dd50-45bd-95b4-4e9daa259b37 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:45.575038 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5827a815-dd50-45bd-95b4-4e9daa259b37 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:45.575510 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5827a815-dd50-45bd-95b4-4e9daa259b37 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:45.738267 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5827a815-dd50-45bd-95b4-4e9daa259b37 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 27321 microversion: 2.20 time: 0.175356 Oct 13 04:18:45.739049 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 92/184] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:45 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 27321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:18:45.747411 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4b8ef12b-8a31-4ed1-a419-da7f06e99916 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:45.748074 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4b8ef12b-8a31-4ed1-a419-da7f06e99916 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:45.754149 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4b8ef12b-8a31-4ed1-a419-da7f06e99916 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:45.754594 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4b8ef12b-8a31-4ed1-a419-da7f06e99916 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:45.755456 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4b8ef12b-8a31-4ed1-a419-da7f06e99916 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:45.755764 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4b8ef12b-8a31-4ed1-a419-da7f06e99916 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:45.796618 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-5a280046-a92c-4b34-af56-02f121df62bf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 27374 microversion: 2.1 time: 0.319760 Oct 13 04:18:45.797286 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 93/185] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:45 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 27374 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:18:45.802569 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e824da13-5e50-4a84-9026-9ae1a3d6a108 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:45.803267 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e824da13-5e50-4a84-9026-9ae1a3d6a108 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:45.809990 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e824da13-5e50-4a84-9026-9ae1a3d6a108 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:45.810432 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e824da13-5e50-4a84-9026-9ae1a3d6a108 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:45.811194 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e824da13-5e50-4a84-9026-9ae1a3d6a108 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:45.811618 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e824da13-5e50-4a84-9026-9ae1a3d6a108 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:45.817082 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4b8ef12b-8a31-4ed1-a419-da7f06e99916 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:45.824414 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4b8ef12b-8a31-4ed1-a419-da7f06e99916 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1265 microversion: 2.1 time: 0.083441 Oct 13 04:18:45.833960 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 93/186] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:45 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:18:46.034702 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-e824da13-5e50-4a84-9026-9ae1a3d6a108 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:46.043197 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e824da13-5e50-4a84-9026-9ae1a3d6a108 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1318 microversion: 2.1 time: 0.244482 Oct 13 04:18:46.052860 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 94/187] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:45 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:46.750857 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7ec85ded-2cce-4e61-9e43-f2314a1a5a7f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:46.752018 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7ec85ded-2cce-4e61-9e43-f2314a1a5a7f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:46.758675 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7ec85ded-2cce-4e61-9e43-f2314a1a5a7f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:46.759353 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7ec85ded-2cce-4e61-9e43-f2314a1a5a7f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:46.760705 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7ec85ded-2cce-4e61-9e43-f2314a1a5a7f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:46.761197 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7ec85ded-2cce-4e61-9e43-f2314a1a5a7f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:46.809293 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-24bd7e8a-7a11-48f3-9d69-0db4d9514e1d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:46.811095 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-24bd7e8a-7a11-48f3-9d69-0db4d9514e1d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:46.817240 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-24bd7e8a-7a11-48f3-9d69-0db4d9514e1d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:46.817698 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-24bd7e8a-7a11-48f3-9d69-0db4d9514e1d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:46.818668 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-24bd7e8a-7a11-48f3-9d69-0db4d9514e1d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:46.819260 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-24bd7e8a-7a11-48f3-9d69-0db4d9514e1d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:46.971075 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7ec85ded-2cce-4e61-9e43-f2314a1a5a7f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 27625 microversion: 2.20 time: 0.223644 Oct 13 04:18:46.972333 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 94/188] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:46 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 27625 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:18:46.977725 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-057a6db7-707a-48f8-9ccb-006e0a38f637 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:46.978526 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-057a6db7-707a-48f8-9ccb-006e0a38f637 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:46.986048 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-057a6db7-707a-48f8-9ccb-006e0a38f637 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:46.986679 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-057a6db7-707a-48f8-9ccb-006e0a38f637 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:46.988186 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-057a6db7-707a-48f8-9ccb-006e0a38f637 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:46.988647 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-057a6db7-707a-48f8-9ccb-006e0a38f637 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:47.016901 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-24bd7e8a-7a11-48f3-9d69-0db4d9514e1d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 27635 microversion: 2.1 time: 0.211602 Oct 13 04:18:47.022762 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 95/189] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:46 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 27635 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:18:47.060824 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f80fe692-dee6-4397-a552-47c23090b6fb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:47.061517 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f80fe692-dee6-4397-a552-47c23090b6fb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:47.068042 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f80fe692-dee6-4397-a552-47c23090b6fb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:47.068482 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f80fe692-dee6-4397-a552-47c23090b6fb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:47.069232 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f80fe692-dee6-4397-a552-47c23090b6fb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:47.069684 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f80fe692-dee6-4397-a552-47c23090b6fb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:47.079343 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-057a6db7-707a-48f8-9ccb-006e0a38f637 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:47.087990 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-057a6db7-707a-48f8-9ccb-006e0a38f637 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1271 microversion: 2.1 time: 0.113750 Oct 13 04:18:47.088821 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 95/190] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:46 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:47.268282 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f80fe692-dee6-4397-a552-47c23090b6fb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:47.276952 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f80fe692-dee6-4397-a552-47c23090b6fb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1318 microversion: 2.1 time: 0.220136 Oct 13 04:18:47.277528 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 96/191] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:47 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:18:47.983161 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-19bb6aea-1932-4b12-b7d6-93a85e3cbaad tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:47.984248 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-19bb6aea-1932-4b12-b7d6-93a85e3cbaad tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:47.990809 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-19bb6aea-1932-4b12-b7d6-93a85e3cbaad tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:47.991253 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-19bb6aea-1932-4b12-b7d6-93a85e3cbaad tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:47.992117 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-19bb6aea-1932-4b12-b7d6-93a85e3cbaad tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:47.992430 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-19bb6aea-1932-4b12-b7d6-93a85e3cbaad tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:48.044249 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-66bfdac9-8c44-4281-b408-71e7d0504ad5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:48.056363 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-66bfdac9-8c44-4281-b408-71e7d0504ad5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:48.076212 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-66bfdac9-8c44-4281-b408-71e7d0504ad5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:48.077044 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-66bfdac9-8c44-4281-b408-71e7d0504ad5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:48.078416 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-66bfdac9-8c44-4281-b408-71e7d0504ad5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:48.080305 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-66bfdac9-8c44-4281-b408-71e7d0504ad5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:48.086354 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-19bb6aea-1932-4b12-b7d6-93a85e3cbaad tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 27862 microversion: 2.20 time: 0.106772 Oct 13 04:18:48.088121 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 96/192] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:47 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 27862 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:18:48.098249 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-88122355-01b8-4cca-9300-b1f1e37813ed req-12541fbc-8446-456a-bf3b-b1c2bda98117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcdcd661-b52b-470d-838a-fab934cb3f15", "tag": "ea758bd2-3fff-4b91-8658-250e948b8fdb"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:48.101315 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:18:48.101315 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:18:48.113869 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-88122355-01b8-4cca-9300-b1f1e37813ed req-12541fbc-8446-456a-bf3b-b1c2bda98117 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:48.114541 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-88122355-01b8-4cca-9300-b1f1e37813ed req-12541fbc-8446-456a-bf3b-b1c2bda98117 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:48.129818 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-88122355-01b8-4cca-9300-b1f1e37813ed req-12541fbc-8446-456a-bf3b-b1c2bda98117 service nova] Creating event network-changed:ea758bd2-3fff-4b91-8658-250e948b8fdb for instance dcdcd661-b52b-470d-838a-fab934cb3f15 on hv-cinder-81275 Oct 13 04:18:48.137197 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-88122355-01b8-4cca-9300-b1f1e37813ed req-12541fbc-8446-456a-bf3b-b1c2bda98117 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047377 Oct 13 04:18:48.140924 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 97/193] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:18:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:18:48.146796 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b7eac9ad-4ba3-41a7-a74f-aef229dd2f11 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:48.147758 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b7eac9ad-4ba3-41a7-a74f-aef229dd2f11 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:48.156304 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b7eac9ad-4ba3-41a7-a74f-aef229dd2f11 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:48.157386 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b7eac9ad-4ba3-41a7-a74f-aef229dd2f11 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:48.158200 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b7eac9ad-4ba3-41a7-a74f-aef229dd2f11 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:48.158762 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b7eac9ad-4ba3-41a7-a74f-aef229dd2f11 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:48.302693 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-66bfdac9-8c44-4281-b408-71e7d0504ad5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 27871 microversion: 2.1 time: 0.276265 Oct 13 04:18:48.303357 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 97/194] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:48 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 27871 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:18:48.308251 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ca28a44e-c7a6-4761-8c85-8de121b3d72a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:48.308967 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ca28a44e-c7a6-4761-8c85-8de121b3d72a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:48.316336 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ca28a44e-c7a6-4761-8c85-8de121b3d72a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:48.316849 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ca28a44e-c7a6-4761-8c85-8de121b3d72a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:48.317536 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ca28a44e-c7a6-4761-8c85-8de121b3d72a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:48.318293 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ca28a44e-c7a6-4761-8c85-8de121b3d72a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:48.400713 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b7eac9ad-4ba3-41a7-a74f-aef229dd2f11 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:48.408040 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b7eac9ad-4ba3-41a7-a74f-aef229dd2f11 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1313 microversion: 2.1 time: 0.265862 Oct 13 04:18:48.408606 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 98/195] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:48 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:48.541106 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ca28a44e-c7a6-4761-8c85-8de121b3d72a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:48.553070 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ca28a44e-c7a6-4761-8c85-8de121b3d72a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1318 microversion: 2.1 time: 0.248487 Oct 13 04:18:48.553780 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 98/196] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:48 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:49.098857 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-bcb52f03-6ada-46c1-b7b3-1dc1d78b994c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:49.099759 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-bcb52f03-6ada-46c1-b7b3-1dc1d78b994c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:49.106159 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bcb52f03-6ada-46c1-b7b3-1dc1d78b994c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:49.106594 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bcb52f03-6ada-46c1-b7b3-1dc1d78b994c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:49.107365 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bcb52f03-6ada-46c1-b7b3-1dc1d78b994c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:49.108050 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bcb52f03-6ada-46c1-b7b3-1dc1d78b994c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:49.315556 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4fe04fa2-637f-485b-b480-cd4772493bc7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:49.316407 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4fe04fa2-637f-485b-b480-cd4772493bc7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:49.322754 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4fe04fa2-637f-485b-b480-cd4772493bc7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:49.323267 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4fe04fa2-637f-485b-b480-cd4772493bc7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:49.324189 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4fe04fa2-637f-485b-b480-cd4772493bc7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:49.324620 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4fe04fa2-637f-485b-b480-cd4772493bc7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:49.415967 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-bcb52f03-6ada-46c1-b7b3-1dc1d78b994c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 27974 microversion: 2.20 time: 0.320668 Oct 13 04:18:49.416810 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 99/197] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:49 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 27974 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:18:49.426046 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b9c64913-3e01-4063-b346-5adf24d94006 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:49.427293 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b9c64913-3e01-4063-b346-5adf24d94006 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:49.433046 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4fe04fa2-637f-485b-b480-cd4772493bc7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28050 microversion: 2.1 time: 0.121840 Oct 13 04:18:49.436998 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 99/198] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:49 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28050 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:18:49.440843 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b9c64913-3e01-4063-b346-5adf24d94006 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:49.441279 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b9c64913-3e01-4063-b346-5adf24d94006 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:49.442076 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b9c64913-3e01-4063-b346-5adf24d94006 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:49.442492 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b9c64913-3e01-4063-b346-5adf24d94006 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:49.570194 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b9c64913-3e01-4063-b346-5adf24d94006 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:49.574320 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b9c64913-3e01-4063-b346-5adf24d94006 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1313 microversion: 2.1 time: 0.153294 Oct 13 04:18:49.574725 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 100/199] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:49 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:18:49.577377 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-49671b5e-7248-4816-a2fc-5936fa374dbf tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:49.578116 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-49671b5e-7248-4816-a2fc-5936fa374dbf tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:49.584572 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-49671b5e-7248-4816-a2fc-5936fa374dbf tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:49.585012 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-49671b5e-7248-4816-a2fc-5936fa374dbf tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:49.585832 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-49671b5e-7248-4816-a2fc-5936fa374dbf tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:49.586254 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-49671b5e-7248-4816-a2fc-5936fa374dbf tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:49.708366 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-49671b5e-7248-4816-a2fc-5936fa374dbf tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:49.715837 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-49671b5e-7248-4816-a2fc-5936fa374dbf tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1318 microversion: 2.1 time: 0.149369 Oct 13 04:18:49.716473 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 100/200] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:49 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:18:50.430587 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ca9d52b2-7cd3-4efa-93e8-7901942607ec tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:50.431567 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ca9d52b2-7cd3-4efa-93e8-7901942607ec tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:50.443309 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ca9d52b2-7cd3-4efa-93e8-7901942607ec tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:50.443755 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ca9d52b2-7cd3-4efa-93e8-7901942607ec tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:50.444523 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ca9d52b2-7cd3-4efa-93e8-7901942607ec tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:50.444950 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ca9d52b2-7cd3-4efa-93e8-7901942607ec tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:50.445051 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-02f407eb-8e5c-4e6d-9a20-37bf08da84e3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:50.446122 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-02f407eb-8e5c-4e6d-9a20-37bf08da84e3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:50.452193 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-02f407eb-8e5c-4e6d-9a20-37bf08da84e3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:50.452626 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-02f407eb-8e5c-4e6d-9a20-37bf08da84e3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:50.453963 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-02f407eb-8e5c-4e6d-9a20-37bf08da84e3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:50.454263 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-02f407eb-8e5c-4e6d-9a20-37bf08da84e3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:50.875639 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-02f407eb-8e5c-4e6d-9a20-37bf08da84e3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28050 microversion: 2.1 time: 0.433935 Oct 13 04:18:50.876514 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 101/201] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:50 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28050 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:18:50.882269 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-cd4c9747-d218-4f92-a6c3-40ac54d519a8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:50.882830 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-cd4c9747-d218-4f92-a6c3-40ac54d519a8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:50.893439 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ca9d52b2-7cd3-4efa-93e8-7901942607ec tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28041 microversion: 2.20 time: 0.466536 Oct 13 04:18:50.894417 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 101/202] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:50 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28041 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:18:50.899011 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-119d15a3-40eb-44af-bf87-33f2082ba600 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:50.899681 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-119d15a3-40eb-44af-bf87-33f2082ba600 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:50.902981 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cd4c9747-d218-4f92-a6c3-40ac54d519a8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:50.903419 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cd4c9747-d218-4f92-a6c3-40ac54d519a8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:50.904258 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cd4c9747-d218-4f92-a6c3-40ac54d519a8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:50.904677 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cd4c9747-d218-4f92-a6c3-40ac54d519a8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:50.914040 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-119d15a3-40eb-44af-bf87-33f2082ba600 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:50.914485 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-119d15a3-40eb-44af-bf87-33f2082ba600 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:50.915252 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-119d15a3-40eb-44af-bf87-33f2082ba600 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:50.915679 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-119d15a3-40eb-44af-bf87-33f2082ba600 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:51.130965 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-cd4c9747-d218-4f92-a6c3-40ac54d519a8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:51.138978 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-cd4c9747-d218-4f92-a6c3-40ac54d519a8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1313 microversion: 2.1 time: 0.260897 Oct 13 04:18:51.139861 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 102/203] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:50 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:51.148326 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-119d15a3-40eb-44af-bf87-33f2082ba600 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:51.156119 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-119d15a3-40eb-44af-bf87-33f2082ba600 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1318 microversion: 2.1 time: 0.260777 Oct 13 04:18:51.156777 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 102/204] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:50 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:51.889223 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c8fd3a3c-a28e-4b3b-971d-0350c0e8a2d6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:51.890245 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c8fd3a3c-a28e-4b3b-971d-0350c0e8a2d6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:51.896914 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c8fd3a3c-a28e-4b3b-971d-0350c0e8a2d6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:51.897354 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c8fd3a3c-a28e-4b3b-971d-0350c0e8a2d6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:51.898182 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c8fd3a3c-a28e-4b3b-971d-0350c0e8a2d6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:51.898710 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c8fd3a3c-a28e-4b3b-971d-0350c0e8a2d6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:51.904475 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ec1b38af-a016-4895-9979-5f50b3d91c2d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:51.905375 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ec1b38af-a016-4895-9979-5f50b3d91c2d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:51.911314 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ec1b38af-a016-4895-9979-5f50b3d91c2d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:51.911867 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ec1b38af-a016-4895-9979-5f50b3d91c2d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:51.912727 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ec1b38af-a016-4895-9979-5f50b3d91c2d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:51.913249 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ec1b38af-a016-4895-9979-5f50b3d91c2d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:55.986589 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ec1b38af-a016-4895-9979-5f50b3d91c2d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28041 microversion: 2.20 time: 4.085720 Oct 13 04:18:55.987284 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 103/205] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:51 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28041 bytes in 4087 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:18:55.992019 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9227745d-5d4d-41df-98d9-3eb5c90090a7 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:55.992699 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9227745d-5d4d-41df-98d9-3eb5c90090a7 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:55.999422 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9227745d-5d4d-41df-98d9-3eb5c90090a7 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:55.999898 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9227745d-5d4d-41df-98d9-3eb5c90090a7 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:56.000657 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9227745d-5d4d-41df-98d9-3eb5c90090a7 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:56.001074 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9227745d-5d4d-41df-98d9-3eb5c90090a7 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:56.140540 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-9227745d-5d4d-41df-98d9-3eb5c90090a7 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:56.151368 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9227745d-5d4d-41df-98d9-3eb5c90090a7 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1313 microversion: 2.1 time: 0.163082 Oct 13 04:18:56.151984 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 104/206] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:55 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:56.156205 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a5961b74-aaa4-4286-9a8e-3bd41d46e7da tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:56.156791 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a5961b74-aaa4-4286-9a8e-3bd41d46e7da tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:56.162642 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a5961b74-aaa4-4286-9a8e-3bd41d46e7da tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:56.163077 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a5961b74-aaa4-4286-9a8e-3bd41d46e7da tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:56.164193 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a5961b74-aaa4-4286-9a8e-3bd41d46e7da tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:56.164617 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a5961b74-aaa4-4286-9a8e-3bd41d46e7da tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:56.192906 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c8fd3a3c-a28e-4b3b-971d-0350c0e8a2d6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 4.308394 Oct 13 04:18:56.193640 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 103/207] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:51 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 4310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:18:56.286673 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a5961b74-aaa4-4286-9a8e-3bd41d46e7da tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:56.294331 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a5961b74-aaa4-4286-9a8e-3bd41d46e7da tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1318 microversion: 2.1 time: 0.141459 Oct 13 04:18:56.295100 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 105/208] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:56 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:56.999112 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3c0c5fa3-b627-44a8-aa11-9e38e2609547 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:57.000670 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3c0c5fa3-b627-44a8-aa11-9e38e2609547 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:57.008486 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3c0c5fa3-b627-44a8-aa11-9e38e2609547 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:57.009332 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3c0c5fa3-b627-44a8-aa11-9e38e2609547 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:57.010476 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3c0c5fa3-b627-44a8-aa11-9e38e2609547 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:57.011013 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3c0c5fa3-b627-44a8-aa11-9e38e2609547 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:57.125708 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3c0c5fa3-b627-44a8-aa11-9e38e2609547 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.130500 Oct 13 04:18:57.126424 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 104/209] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:56 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:18:57.168533 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a618224a-0456-4b29-a523-5641ec569ef1 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:57.169213 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a618224a-0456-4b29-a523-5641ec569ef1 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:57.175681 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a618224a-0456-4b29-a523-5641ec569ef1 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:57.176132 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a618224a-0456-4b29-a523-5641ec569ef1 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:57.176878 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a618224a-0456-4b29-a523-5641ec569ef1 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:57.177299 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a618224a-0456-4b29-a523-5641ec569ef1 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:57.204925 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d0c77c81-3351-49a0-be9d-7ae8075d7860 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:57.206707 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d0c77c81-3351-49a0-be9d-7ae8075d7860 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:57.213010 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0c77c81-3351-49a0-be9d-7ae8075d7860 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:57.213440 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0c77c81-3351-49a0-be9d-7ae8075d7860 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:57.214237 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0c77c81-3351-49a0-be9d-7ae8075d7860 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:57.214655 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0c77c81-3351-49a0-be9d-7ae8075d7860 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:57.331867 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d0c77c81-3351-49a0-be9d-7ae8075d7860 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.130944 Oct 13 04:18:57.336286 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 105/210] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:57 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:18:57.338628 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7242f133-14f0-46c4-9e4f-573a83000b1c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:57.339480 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7242f133-14f0-46c4-9e4f-573a83000b1c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:57.346571 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7242f133-14f0-46c4-9e4f-573a83000b1c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:57.347467 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7242f133-14f0-46c4-9e4f-573a83000b1c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:57.348261 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7242f133-14f0-46c4-9e4f-573a83000b1c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:57.348689 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7242f133-14f0-46c4-9e4f-573a83000b1c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:57.377168 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a618224a-0456-4b29-a523-5641ec569ef1 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:57.386631 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a618224a-0456-4b29-a523-5641ec569ef1 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1313 microversion: 2.1 time: 0.221761 Oct 13 04:18:57.387330 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 106/211] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:57 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:57.548429 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-7242f133-14f0-46c4-9e4f-573a83000b1c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:57.560285 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7242f133-14f0-46c4-9e4f-573a83000b1c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1318 microversion: 2.1 time: 0.225787 Oct 13 04:18:57.560862 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 106/212] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:57 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:58.137407 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a84b6d0f-78a8-4b71-bde9-30311fa52b0f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:58.138414 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a84b6d0f-78a8-4b71-bde9-30311fa52b0f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:58.144499 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a84b6d0f-78a8-4b71-bde9-30311fa52b0f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:58.145187 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a84b6d0f-78a8-4b71-bde9-30311fa52b0f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:58.146100 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a84b6d0f-78a8-4b71-bde9-30311fa52b0f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:58.146761 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a84b6d0f-78a8-4b71-bde9-30311fa52b0f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:58.344565 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f3f382e2-e9cf-4d3b-a3f9-3a9375f189c4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:58.345485 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f3f382e2-e9cf-4d3b-a3f9-3a9375f189c4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:58.352041 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3f382e2-e9cf-4d3b-a3f9-3a9375f189c4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:58.352485 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3f382e2-e9cf-4d3b-a3f9-3a9375f189c4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:58.353252 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3f382e2-e9cf-4d3b-a3f9-3a9375f189c4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:58.353719 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3f382e2-e9cf-4d3b-a3f9-3a9375f189c4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:58.494167 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a84b6d0f-78a8-4b71-bde9-30311fa52b0f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.360240 Oct 13 04:18:58.494794 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 107/213] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:58 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:18:58.499650 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-cebaf87c-860b-450c-acf5-c1066b50fa29 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:58.500338 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-cebaf87c-860b-450c-acf5-c1066b50fa29 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:58.506787 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cebaf87c-860b-450c-acf5-c1066b50fa29 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:58.507263 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cebaf87c-860b-450c-acf5-c1066b50fa29 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:58.508011 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cebaf87c-860b-450c-acf5-c1066b50fa29 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:58.512462 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cebaf87c-860b-450c-acf5-c1066b50fa29 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:58.516426 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f3f382e2-e9cf-4d3b-a3f9-3a9375f189c4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.175795 Oct 13 04:18:58.518423 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 107/214] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:58 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:18:58.578871 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-bab4c248-5b77-4620-a261-622870fd08b6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:58.579819 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-bab4c248-5b77-4620-a261-622870fd08b6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:58.586697 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bab4c248-5b77-4620-a261-622870fd08b6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:58.587256 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bab4c248-5b77-4620-a261-622870fd08b6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:58.588020 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bab4c248-5b77-4620-a261-622870fd08b6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:58.588445 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bab4c248-5b77-4620-a261-622870fd08b6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:58.667684 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-cebaf87c-860b-450c-acf5-c1066b50fa29 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:58.675069 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-cebaf87c-860b-450c-acf5-c1066b50fa29 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1313 microversion: 2.1 time: 0.179139 Oct 13 04:18:58.675679 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 108/215] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:58 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:58.736449 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-bab4c248-5b77-4620-a261-622870fd08b6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:58.743806 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-bab4c248-5b77-4620-a261-622870fd08b6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1318 microversion: 2.1 time: 0.169529 Oct 13 04:18:58.744361 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 108/216] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:58 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:18:58.998090 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-88dd7b41-a597-4945-8bbd-cb8ff4e7da4c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:58.998586 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-88dd7b41-a597-4945-8bbd-cb8ff4e7da4c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:59.004727 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-88dd7b41-a597-4945-8bbd-cb8ff4e7da4c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:59.005171 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-88dd7b41-a597-4945-8bbd-cb8ff4e7da4c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:59.005969 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-88dd7b41-a597-4945-8bbd-cb8ff4e7da4c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:59.006391 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-88dd7b41-a597-4945-8bbd-cb8ff4e7da4c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:59.032108 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-88dd7b41-a597-4945-8bbd-cb8ff4e7da4c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Going to try to terminate instance {{(pid=108260) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:18:59.125120 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-88dd7b41-a597-4945-8bbd-cb8ff4e7da4c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "DELETE /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 204 len: 0 microversion: 2.1 time: 0.130369 Oct 13 04:18:59.128836 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 109/217] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:18:58 2021] DELETE /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:18:59.141161 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f12b6e6a-20f2-47c5-ac02-17221c947744 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:59.141792 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f12b6e6a-20f2-47c5-ac02-17221c947744 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:59.147632 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f12b6e6a-20f2-47c5-ac02-17221c947744 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:59.148281 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f12b6e6a-20f2-47c5-ac02-17221c947744 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:59.149191 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f12b6e6a-20f2-47c5-ac02-17221c947744 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:59.149806 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f12b6e6a-20f2-47c5-ac02-17221c947744 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:59.273442 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f12b6e6a-20f2-47c5-ac02-17221c947744 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:59.282502 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f12b6e6a-20f2-47c5-ac02-17221c947744 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1553 microversion: 2.1 time: 0.144909 Oct 13 04:18:59.283138 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 109/218] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:59 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1553 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:59.506605 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e0f9071e-bb37-4c35-91ff-772457eb5452 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:59.507632 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e0f9071e-bb37-4c35-91ff-772457eb5452 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:59.515530 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e0f9071e-bb37-4c35-91ff-772457eb5452 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:59.515954 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e0f9071e-bb37-4c35-91ff-772457eb5452 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:59.517124 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e0f9071e-bb37-4c35-91ff-772457eb5452 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:59.517777 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e0f9071e-bb37-4c35-91ff-772457eb5452 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:59.529146 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-58764ec1-393f-4fa5-9ac1-ae26ba03aaa1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:18:59.530329 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-58764ec1-393f-4fa5-9ac1-ae26ba03aaa1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:59.536615 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-58764ec1-393f-4fa5-9ac1-ae26ba03aaa1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:59.537075 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-58764ec1-393f-4fa5-9ac1-ae26ba03aaa1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:59.537965 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-58764ec1-393f-4fa5-9ac1-ae26ba03aaa1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:59.538867 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-58764ec1-393f-4fa5-9ac1-ae26ba03aaa1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:59.585052 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e0f9071e-bb37-4c35-91ff-772457eb5452 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.082280 Oct 13 04:18:59.585718 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 110/219] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:18:59 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:18:59.609150 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-58764ec1-393f-4fa5-9ac1-ae26ba03aaa1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.084023 Oct 13 04:18:59.612780 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 110/220] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:18:59 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:18:59.692455 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-23338dcf-b222-4b66-9769-532f41b8543c tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:59.693450 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-23338dcf-b222-4b66-9769-532f41b8543c tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:59.700283 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-23338dcf-b222-4b66-9769-532f41b8543c tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:59.700610 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-23338dcf-b222-4b66-9769-532f41b8543c tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:59.701392 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-23338dcf-b222-4b66-9769-532f41b8543c tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:59.701867 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-23338dcf-b222-4b66-9769-532f41b8543c tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:59.762978 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0c6897de-362f-4150-a4d2-4b4393d12992 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:18:59.763663 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0c6897de-362f-4150-a4d2-4b4393d12992 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:18:59.769947 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0c6897de-362f-4150-a4d2-4b4393d12992 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:59.770421 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0c6897de-362f-4150-a4d2-4b4393d12992 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:59.771198 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0c6897de-362f-4150-a4d2-4b4393d12992 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:18:59.771593 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0c6897de-362f-4150-a4d2-4b4393d12992 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:18:59.856023 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-23338dcf-b222-4b66-9769-532f41b8543c tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:59.863235 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-23338dcf-b222-4b66-9769-532f41b8543c tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1313 microversion: 2.1 time: 0.174865 Oct 13 04:18:59.863710 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 111/221] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:59 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:18:59.910834 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-0c6897de-362f-4150-a4d2-4b4393d12992 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:18:59.919256 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0c6897de-362f-4150-a4d2-4b4393d12992 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1318 microversion: 2.1 time: 0.160697 Oct 13 04:18:59.919816 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 111/222] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:18:59 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:00.143815 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-00edaacb-9193-45c2-9eb9-9f4a6315341f req-29704f91-ccb0-4bf1-99cf-82fd0e32299f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5", "name": "network-vif-plugged", "status": "completed", "tag": "0873d595-38af-475f-97a0-d07dd43fbdb5"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:00.145149 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:19:00.145149 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:19:00.152635 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-00edaacb-9193-45c2-9eb9-9f4a6315341f req-29704f91-ccb0-4bf1-99cf-82fd0e32299f service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:00.153211 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-00edaacb-9193-45c2-9eb9-9f4a6315341f req-29704f91-ccb0-4bf1-99cf-82fd0e32299f service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:00.166639 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-00edaacb-9193-45c2-9eb9-9f4a6315341f req-29704f91-ccb0-4bf1-99cf-82fd0e32299f service nova] Creating event network-vif-plugged:0873d595-38af-475f-97a0-d07dd43fbdb5 for instance f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 on hv-cinder-81275 Oct 13 04:19:00.172310 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-00edaacb-9193-45c2-9eb9-9f4a6315341f req-29704f91-ccb0-4bf1-99cf-82fd0e32299f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032282 Oct 13 04:19:00.173790 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 112/223] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:19:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:00.300179 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8a160e8c-a60c-4b61-903a-77dbb697c80e tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:00.300785 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-8a160e8c-a60c-4b61-903a-77dbb697c80e tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:00.308932 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8a160e8c-a60c-4b61-903a-77dbb697c80e tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:00.309392 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8a160e8c-a60c-4b61-903a-77dbb697c80e tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:00.310435 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8a160e8c-a60c-4b61-903a-77dbb697c80e tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:00.310974 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8a160e8c-a60c-4b61-903a-77dbb697c80e tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:00.475017 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-8a160e8c-a60c-4b61-903a-77dbb697c80e tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:00.486436 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-8a160e8c-a60c-4b61-903a-77dbb697c80e tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1553 microversion: 2.1 time: 0.189661 Oct 13 04:19:00.487307 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 112/224] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:00 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:00.597350 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9a276695-ad7e-4345-b201-e22421c23a03 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:00.598338 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9a276695-ad7e-4345-b201-e22421c23a03 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:00.604498 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9a276695-ad7e-4345-b201-e22421c23a03 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:00.604937 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9a276695-ad7e-4345-b201-e22421c23a03 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:00.605722 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9a276695-ad7e-4345-b201-e22421c23a03 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:00.606149 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9a276695-ad7e-4345-b201-e22421c23a03 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:00.620223 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-bd2ed668-e354-483c-a9e2-c56cba9f9e10 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:00.621144 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-bd2ed668-e354-483c-a9e2-c56cba9f9e10 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:00.627185 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bd2ed668-e354-483c-a9e2-c56cba9f9e10 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:00.627621 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bd2ed668-e354-483c-a9e2-c56cba9f9e10 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:00.628398 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bd2ed668-e354-483c-a9e2-c56cba9f9e10 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:00.628817 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bd2ed668-e354-483c-a9e2-c56cba9f9e10 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:00.817492 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-bd2ed668-e354-483c-a9e2-c56cba9f9e10 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.200706 Oct 13 04:19:00.819062 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 113/225] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:00 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:00.820210 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9a276695-ad7e-4345-b201-e22421c23a03 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.226830 Oct 13 04:19:00.822065 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 113/226] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:00 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:00.880578 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c911448e-925a-4e5c-9a05-cdac71eae971 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:00.881357 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c911448e-925a-4e5c-9a05-cdac71eae971 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:00.888093 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c911448e-925a-4e5c-9a05-cdac71eae971 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:00.888609 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c911448e-925a-4e5c-9a05-cdac71eae971 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:00.889492 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c911448e-925a-4e5c-9a05-cdac71eae971 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:00.890009 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c911448e-925a-4e5c-9a05-cdac71eae971 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:00.937133 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-93f960c0-6b68-4255-81a2-c43674131d52 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:00.938093 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-93f960c0-6b68-4255-81a2-c43674131d52 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:00.944819 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-93f960c0-6b68-4255-81a2-c43674131d52 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:00.945346 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-93f960c0-6b68-4255-81a2-c43674131d52 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:00.946211 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-93f960c0-6b68-4255-81a2-c43674131d52 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:00.946692 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-93f960c0-6b68-4255-81a2-c43674131d52 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:01.088337 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c911448e-925a-4e5c-9a05-cdac71eae971 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:01.097774 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c911448e-925a-4e5c-9a05-cdac71eae971 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1313 microversion: 2.1 time: 0.221179 Oct 13 04:19:01.098349 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 114/227] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:00 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:01.140586 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-93f960c0-6b68-4255-81a2-c43674131d52 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:01.148136 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-93f960c0-6b68-4255-81a2-c43674131d52 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1318 microversion: 2.1 time: 0.215482 Oct 13 04:19:01.148698 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 114/228] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:00 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:01.503886 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c7b4082b-7479-40fb-a65a-904db291ab46 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:01.504642 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c7b4082b-7479-40fb-a65a-904db291ab46 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:01.510638 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7b4082b-7479-40fb-a65a-904db291ab46 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:01.511077 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7b4082b-7479-40fb-a65a-904db291ab46 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:01.511953 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7b4082b-7479-40fb-a65a-904db291ab46 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:01.512378 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7b4082b-7479-40fb-a65a-904db291ab46 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:01.830692 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7bd63e36-de3b-4db9-a58d-c8fa92c9bcd4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:01.831773 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7bd63e36-de3b-4db9-a58d-c8fa92c9bcd4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:01.841522 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7bd63e36-de3b-4db9-a58d-c8fa92c9bcd4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:01.841522 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7bd63e36-de3b-4db9-a58d-c8fa92c9bcd4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:01.841522 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7bd63e36-de3b-4db9-a58d-c8fa92c9bcd4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:01.841522 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7bd63e36-de3b-4db9-a58d-c8fa92c9bcd4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:01.860234 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c7b4082b-7479-40fb-a65a-904db291ab46 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:01.869522 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c7b4082b-7479-40fb-a65a-904db291ab46 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1553 microversion: 2.1 time: 0.369337 Oct 13 04:19:01.870656 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 115/229] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:01 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1553 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:01.875218 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-aae82fc0-16f8-49fc-8097-b8fa27890e9c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:01.876229 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-aae82fc0-16f8-49fc-8097-b8fa27890e9c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:01.881989 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aae82fc0-16f8-49fc-8097-b8fa27890e9c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:01.882430 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aae82fc0-16f8-49fc-8097-b8fa27890e9c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:01.883204 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aae82fc0-16f8-49fc-8097-b8fa27890e9c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:01.883612 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aae82fc0-16f8-49fc-8097-b8fa27890e9c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:01.918140 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7bd63e36-de3b-4db9-a58d-c8fa92c9bcd4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.092334 Oct 13 04:19:01.918802 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 115/230] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:01 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:19:01.952403 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-aae82fc0-16f8-49fc-8097-b8fa27890e9c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.080438 Oct 13 04:19:01.953362 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 116/231] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:01 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:02.118443 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e4cc3d7d-6851-46db-9e7b-b918aa6b8bf8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:02.119103 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e4cc3d7d-6851-46db-9e7b-b918aa6b8bf8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:02.126806 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e4cc3d7d-6851-46db-9e7b-b918aa6b8bf8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:02.127243 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e4cc3d7d-6851-46db-9e7b-b918aa6b8bf8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:02.127991 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e4cc3d7d-6851-46db-9e7b-b918aa6b8bf8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:02.128937 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e4cc3d7d-6851-46db-9e7b-b918aa6b8bf8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:02.171811 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2d48c6fa-3eb5-4835-9848-370022496df3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:02.173910 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2d48c6fa-3eb5-4835-9848-370022496df3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:02.185204 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2d48c6fa-3eb5-4835-9848-370022496df3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:02.185972 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2d48c6fa-3eb5-4835-9848-370022496df3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:02.186963 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2d48c6fa-3eb5-4835-9848-370022496df3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:02.187580 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2d48c6fa-3eb5-4835-9848-370022496df3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:02.301045 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-e4cc3d7d-6851-46db-9e7b-b918aa6b8bf8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:02.312382 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e4cc3d7d-6851-46db-9e7b-b918aa6b8bf8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1313 microversion: 2.1 time: 0.198271 Oct 13 04:19:02.313770 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 116/232] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:02 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:02.379359 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2d48c6fa-3eb5-4835-9848-370022496df3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:02.388236 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2d48c6fa-3eb5-4835-9848-370022496df3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1318 microversion: 2.1 time: 0.226164 Oct 13 04:19:02.388902 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 117/233] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:02 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:02.887015 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c284373a-ff0a-46d4-9730-73fa564b5dc0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:02.887583 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c284373a-ff0a-46d4-9730-73fa564b5dc0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:02.893852 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c284373a-ff0a-46d4-9730-73fa564b5dc0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:02.894298 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c284373a-ff0a-46d4-9730-73fa564b5dc0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:02.895056 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c284373a-ff0a-46d4-9730-73fa564b5dc0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:02.895486 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c284373a-ff0a-46d4-9730-73fa564b5dc0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:02.930110 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7d6171d5-0e9e-4561-a1ca-f5febb64fbb7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:02.931035 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7d6171d5-0e9e-4561-a1ca-f5febb64fbb7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:02.937638 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7d6171d5-0e9e-4561-a1ca-f5febb64fbb7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:02.938108 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7d6171d5-0e9e-4561-a1ca-f5febb64fbb7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:02.938887 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7d6171d5-0e9e-4561-a1ca-f5febb64fbb7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:02.939319 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7d6171d5-0e9e-4561-a1ca-f5febb64fbb7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:03.021520 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-c284373a-ff0a-46d4-9730-73fa564b5dc0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:03.027343 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7d6171d5-0e9e-4561-a1ca-f5febb64fbb7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.099474 Oct 13 04:19:03.030480 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 118/234] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:02 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:03.030611 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c284373a-ff0a-46d4-9730-73fa564b5dc0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1553 microversion: 2.1 time: 0.147218 Oct 13 04:19:03.031126 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 117/235] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:02 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:03.033782 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f44b3263-9a2d-4bc6-8e55-a3af796b40af tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:03.034780 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f44b3263-9a2d-4bc6-8e55-a3af796b40af tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:03.041982 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f44b3263-9a2d-4bc6-8e55-a3af796b40af tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:03.042344 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f44b3263-9a2d-4bc6-8e55-a3af796b40af tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:03.043093 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f44b3263-9a2d-4bc6-8e55-a3af796b40af tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:03.043500 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f44b3263-9a2d-4bc6-8e55-a3af796b40af tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:03.123640 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f44b3263-9a2d-4bc6-8e55-a3af796b40af tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.093823 Oct 13 04:19:03.124329 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 119/236] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:03 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:03.329910 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b0d1ef85-f114-4a0d-8bff-4d86d42ac767 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:03.330518 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b0d1ef85-f114-4a0d-8bff-4d86d42ac767 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:03.337363 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0d1ef85-f114-4a0d-8bff-4d86d42ac767 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:03.337854 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0d1ef85-f114-4a0d-8bff-4d86d42ac767 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:03.338608 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0d1ef85-f114-4a0d-8bff-4d86d42ac767 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:03.339039 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0d1ef85-f114-4a0d-8bff-4d86d42ac767 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:03.453087 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a08f35cd-613f-41a6-82ef-8d8c22411d6d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:03.453525 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a08f35cd-613f-41a6-82ef-8d8c22411d6d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:03.460437 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a08f35cd-613f-41a6-82ef-8d8c22411d6d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:03.460896 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a08f35cd-613f-41a6-82ef-8d8c22411d6d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:03.461865 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a08f35cd-613f-41a6-82ef-8d8c22411d6d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:03.462502 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a08f35cd-613f-41a6-82ef-8d8c22411d6d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:03.469104 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b0d1ef85-f114-4a0d-8bff-4d86d42ac767 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:03.478650 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b0d1ef85-f114-4a0d-8bff-4d86d42ac767 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1313 microversion: 2.1 time: 0.150267 Oct 13 04:19:03.485572 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 118/237] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:03 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:03.603679 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a08f35cd-613f-41a6-82ef-8d8c22411d6d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:03.611037 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a08f35cd-613f-41a6-82ef-8d8c22411d6d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1508 microversion: 2.1 time: 0.163669 Oct 13 04:19:03.611602 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 120/238] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:03 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:03.629333 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-11f38833-8f5f-4768-b06a-84ec6ae6e965 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "231ec7ad-c1c8-441a-987d-d19357a59200"}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:03.630554 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-11f38833-8f5f-4768-b06a-84ec6ae6e965 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:03.636734 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-11f38833-8f5f-4768-b06a-84ec6ae6e965 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:03.637239 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-11f38833-8f5f-4768-b06a-84ec6ae6e965 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:03.638104 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-11f38833-8f5f-4768-b06a-84ec6ae6e965 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:03.638586 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-11f38833-8f5f-4768-b06a-84ec6ae6e965 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:03.717551 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-11f38833-8f5f-4768-b06a-84ec6ae6e965 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] HTTP exception thrown: Invalid volume: volume 231ec7ad-c1c8-441a-987d-d19357a59200 is already attached to instances: d91ac1af-2378-4b6f-9ca7-08181ffe7d44 Oct 13 04:19:03.718196 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-11f38833-8f5f-4768-b06a-84ec6ae6e965 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Returning 400 to user: Invalid volume: volume 231ec7ad-c1c8-441a-987d-d19357a59200 is already attached to instances: d91ac1af-2378-4b6f-9ca7-08181ffe7d44 {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:19:03.719019 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-11f38833-8f5f-4768-b06a-84ec6ae6e965 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "POST /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093661 Oct 13 04:19:03.719559 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 119/239] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Oct 13 04:19:03 2021] POST /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 04:19:03.778538 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c7ce894a-2086-4de3-bac7-2f8fafedd9b9 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:03.779539 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c7ce894a-2086-4de3-bac7-2f8fafedd9b9 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:03.785749 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7ce894a-2086-4de3-bac7-2f8fafedd9b9 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:03.786192 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7ce894a-2086-4de3-bac7-2f8fafedd9b9 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:03.786952 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7ce894a-2086-4de3-bac7-2f8fafedd9b9 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:03.787373 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7ce894a-2086-4de3-bac7-2f8fafedd9b9 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:03.915161 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-c7ce894a-2086-4de3-bac7-2f8fafedd9b9 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lazy-loading 'services' on Instance uuid d91ac1af-2378-4b6f-9ca7-08181ffe7d44 {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:19:04.031426 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c7ce894a-2086-4de3-bac7-2f8fafedd9b9 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments/231ec7ad-c1c8-441a-987d-d19357a59200" status: 202 len: 0 microversion: 2.1 time: 0.256276 Oct 13 04:19:04.034694 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 121/240] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Oct 13 04:19:03 2021] DELETE /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments/231ec7ad-c1c8-441a-987d-d19357a59200 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:04.045282 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-8e7ab4fd-31d5-43ba-bc1f-e9549a35a138 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:04.045985 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c6ec9551-92f2-4428-934a-6f490900e382 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:04.046829 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c6ec9551-92f2-4428-934a-6f490900e382 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:04.053938 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-8e7ab4fd-31d5-43ba-bc1f-e9549a35a138 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:04.054977 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c6ec9551-92f2-4428-934a-6f490900e382 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:04.055423 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c6ec9551-92f2-4428-934a-6f490900e382 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:04.056256 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c6ec9551-92f2-4428-934a-6f490900e382 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:04.056896 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c6ec9551-92f2-4428-934a-6f490900e382 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:04.064437 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8e7ab4fd-31d5-43ba-bc1f-e9549a35a138 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:04.065827 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8e7ab4fd-31d5-43ba-bc1f-e9549a35a138 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:04.078330 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8e7ab4fd-31d5-43ba-bc1f-e9549a35a138 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:04.079972 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8e7ab4fd-31d5-43ba-bc1f-e9549a35a138 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:04.164396 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-8e7ab4fd-31d5-43ba-bc1f-e9549a35a138 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.129257 Oct 13 04:19:04.165671 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 120/241] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:04 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:04.170739 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3d799fce-83cf-4518-b0b3-316a04aaab5a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:04.171466 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3d799fce-83cf-4518-b0b3-316a04aaab5a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:04.177990 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3d799fce-83cf-4518-b0b3-316a04aaab5a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:04.178432 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3d799fce-83cf-4518-b0b3-316a04aaab5a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:04.179303 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3d799fce-83cf-4518-b0b3-316a04aaab5a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:04.179987 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3d799fce-83cf-4518-b0b3-316a04aaab5a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:04.296776 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c6ec9551-92f2-4428-934a-6f490900e382 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.257200 Oct 13 04:19:04.297519 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 122/242] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:19:04 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments => generated 197 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:04.305992 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c7fcaad3-b65f-41f2-910f-593c4e027420 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:04.307017 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c7fcaad3-b65f-41f2-910f-593c4e027420 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:04.313066 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7fcaad3-b65f-41f2-910f-593c4e027420 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:04.313626 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7fcaad3-b65f-41f2-910f-593c4e027420 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:04.314487 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7fcaad3-b65f-41f2-910f-593c4e027420 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:04.315000 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7fcaad3-b65f-41f2-910f-593c4e027420 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:04.339401 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-3d799fce-83cf-4518-b0b3-316a04aaab5a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:04.349371 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3d799fce-83cf-4518-b0b3-316a04aaab5a tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1553 microversion: 2.1 time: 0.182944 Oct 13 04:19:04.350078 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 121/243] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:04 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:04.358969 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-fb8ce197-5258-467d-ba72-8a037859b95d req-5444d306-002c-4a06-b200-362d4c948239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcdcd661-b52b-470d-838a-fab934cb3f15", "name": "network-vif-plugged", "status": "completed", "tag": "ea758bd2-3fff-4b91-8658-250e948b8fdb"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:04.358969 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:19:04.358969 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:19:04.364178 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-fb8ce197-5258-467d-ba72-8a037859b95d req-5444d306-002c-4a06-b200-362d4c948239 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:04.364713 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-fb8ce197-5258-467d-ba72-8a037859b95d req-5444d306-002c-4a06-b200-362d4c948239 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:04.376003 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-fb8ce197-5258-467d-ba72-8a037859b95d req-5444d306-002c-4a06-b200-362d4c948239 service nova] Creating event network-vif-plugged:ea758bd2-3fff-4b91-8658-250e948b8fdb for instance dcdcd661-b52b-470d-838a-fab934cb3f15 on hv-cinder-81275 Oct 13 04:19:04.380866 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-fb8ce197-5258-467d-ba72-8a037859b95d req-5444d306-002c-4a06-b200-362d4c948239 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029623 Oct 13 04:19:04.381786 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 122/244] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:19:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:04.493629 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2f2ecb40-72d0-4efc-b079-775e1286197f tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:04.494314 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-2f2ecb40-72d0-4efc-b079-775e1286197f tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:04.500561 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2f2ecb40-72d0-4efc-b079-775e1286197f tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:04.501224 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2f2ecb40-72d0-4efc-b079-775e1286197f tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:04.502034 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2f2ecb40-72d0-4efc-b079-775e1286197f tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:04.502463 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2f2ecb40-72d0-4efc-b079-775e1286197f tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:04.670192 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-2f2ecb40-72d0-4efc-b079-775e1286197f tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:04.677584 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-2f2ecb40-72d0-4efc-b079-775e1286197f tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1313 microversion: 2.1 time: 0.187971 Oct 13 04:19:04.678173 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 123/245] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:04 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:05.176624 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-264e940d-2e80-41dc-8d00-c4ecb787c8e6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:05.177540 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-264e940d-2e80-41dc-8d00-c4ecb787c8e6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:05.187376 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-264e940d-2e80-41dc-8d00-c4ecb787c8e6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:05.187802 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-264e940d-2e80-41dc-8d00-c4ecb787c8e6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:05.188576 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-264e940d-2e80-41dc-8d00-c4ecb787c8e6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:05.188989 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-264e940d-2e80-41dc-8d00-c4ecb787c8e6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:07.017821 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c7fcaad3-b65f-41f2-910f-593c4e027420 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 2.715306 Oct 13 04:19:07.018511 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 123/246] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:04 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 2720 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:07.020756 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-264e940d-2e80-41dc-8d00-c4ecb787c8e6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 1.847620 Oct 13 04:19:07.021761 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 124/247] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:05 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:07.023544 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-78abfe86-1ac1-4663-b382-007f51c77ba1 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:07.024528 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-78abfe86-1ac1-4663-b382-007f51c77ba1 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:07.026592 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-35f63166-3048-4bc8-8fdb-afb50931a27d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:07.027310 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-35f63166-3048-4bc8-8fdb-afb50931a27d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:07.031184 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-78abfe86-1ac1-4663-b382-007f51c77ba1 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:07.031648 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-78abfe86-1ac1-4663-b382-007f51c77ba1 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:07.032537 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-78abfe86-1ac1-4663-b382-007f51c77ba1 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:07.032982 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-78abfe86-1ac1-4663-b382-007f51c77ba1 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:07.033771 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-35f63166-3048-4bc8-8fdb-afb50931a27d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:07.034229 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-35f63166-3048-4bc8-8fdb-afb50931a27d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:07.035084 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-35f63166-3048-4bc8-8fdb-afb50931a27d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:07.035399 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-35f63166-3048-4bc8-8fdb-afb50931a27d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:07.063636 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-78abfe86-1ac1-4663-b382-007f51c77ba1 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044024 Oct 13 04:19:07.064300 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 124/248] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:19:07 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:07.070935 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-33aa8352-d29b-4f7d-9cf6-104b2eea8a71 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:07.071530 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-33aa8352-d29b-4f7d-9cf6-104b2eea8a71 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:07.077579 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-33aa8352-d29b-4f7d-9cf6-104b2eea8a71 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:07.078951 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-33aa8352-d29b-4f7d-9cf6-104b2eea8a71 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:07.078951 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-33aa8352-d29b-4f7d-9cf6-104b2eea8a71 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:07.079247 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-33aa8352-d29b-4f7d-9cf6-104b2eea8a71 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:07.194219 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-35f63166-3048-4bc8-8fdb-afb50931a27d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:07.202017 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-35f63166-3048-4bc8-8fdb-afb50931a27d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1553 microversion: 2.1 time: 0.179053 Oct 13 04:19:07.202574 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 125/249] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:07 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:07.215142 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-319740b2-585b-4d78-9fe7-c4fb51388c5f req-f346bf69-9e21-4d12-8826-1019646647a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ddad073-1d60-49aa-808b-97fd2684790f", "name": "network-vif-unplugged", "status": "completed", "tag": "02af8261-af42-436d-81a0-3ab22dbcea77"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:07.216624 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:19:07.216624 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:19:07.223707 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-319740b2-585b-4d78-9fe7-c4fb51388c5f req-f346bf69-9e21-4d12-8826-1019646647a0 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:07.224134 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-319740b2-585b-4d78-9fe7-c4fb51388c5f req-f346bf69-9e21-4d12-8826-1019646647a0 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:07.234608 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-319740b2-585b-4d78-9fe7-c4fb51388c5f req-f346bf69-9e21-4d12-8826-1019646647a0 service nova] Creating event network-vif-unplugged:02af8261-af42-436d-81a0-3ab22dbcea77 for instance 0ddad073-1d60-49aa-808b-97fd2684790f on hv-cinder-81275 Oct 13 04:19:07.240402 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-319740b2-585b-4d78-9fe7-c4fb51388c5f req-f346bf69-9e21-4d12-8826-1019646647a0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036734 Oct 13 04:19:07.241262 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 126/250] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:19:07 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:07.247759 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-33aa8352-d29b-4f7d-9cf6-104b2eea8a71 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:07.256153 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-33aa8352-d29b-4f7d-9cf6-104b2eea8a71 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1313 microversion: 2.1 time: 0.188489 Oct 13 04:19:07.256771 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 125/251] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:07 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:08.031816 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2b59c165-4b31-49ab-bc2e-2b90bd4412c4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:08.031816 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-2b59c165-4b31-49ab-bc2e-2b90bd4412c4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:08.032564 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-796e79b2-dd70-4cd2-a0eb-8b8bc4692ba1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:08.033365 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-796e79b2-dd70-4cd2-a0eb-8b8bc4692ba1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:08.037917 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2b59c165-4b31-49ab-bc2e-2b90bd4412c4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:08.038869 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2b59c165-4b31-49ab-bc2e-2b90bd4412c4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:08.039634 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2b59c165-4b31-49ab-bc2e-2b90bd4412c4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:08.040050 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2b59c165-4b31-49ab-bc2e-2b90bd4412c4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:08.040275 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-796e79b2-dd70-4cd2-a0eb-8b8bc4692ba1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:08.040666 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-796e79b2-dd70-4cd2-a0eb-8b8bc4692ba1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:08.041444 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-796e79b2-dd70-4cd2-a0eb-8b8bc4692ba1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:08.041915 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-796e79b2-dd70-4cd2-a0eb-8b8bc4692ba1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:08.140908 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-796e79b2-dd70-4cd2-a0eb-8b8bc4692ba1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.112216 Oct 13 04:19:08.141994 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 126/252] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:08 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:08.147235 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-65f4d10d-d276-4e43-a585-df82e8be9378 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:08.148254 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-65f4d10d-d276-4e43-a585-df82e8be9378 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:08.154967 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-65f4d10d-d276-4e43-a585-df82e8be9378 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:08.155396 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-65f4d10d-d276-4e43-a585-df82e8be9378 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:08.155542 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-2b59c165-4b31-49ab-bc2e-2b90bd4412c4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.130368 Oct 13 04:19:08.156153 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-65f4d10d-d276-4e43-a585-df82e8be9378 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:08.156751 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-65f4d10d-d276-4e43-a585-df82e8be9378 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:08.159784 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 127/253] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:08 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:08.188959 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-65f4d10d-d276-4e43-a585-df82e8be9378 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045766 Oct 13 04:19:08.189560 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 127/254] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:19:08 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:08.219845 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-051c1e29-48d8-48f4-b66a-83939d73f8f4 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:08.220726 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-051c1e29-48d8-48f4-b66a-83939d73f8f4 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:08.228142 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-051c1e29-48d8-48f4-b66a-83939d73f8f4 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:08.228583 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-051c1e29-48d8-48f4-b66a-83939d73f8f4 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:08.229347 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-051c1e29-48d8-48f4-b66a-83939d73f8f4 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:08.229806 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-051c1e29-48d8-48f4-b66a-83939d73f8f4 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:08.272452 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-fc2d1a20-595a-495d-81df-aac615a1e77b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:08.272952 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-fc2d1a20-595a-495d-81df-aac615a1e77b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:08.279413 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fc2d1a20-595a-495d-81df-aac615a1e77b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:08.279865 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fc2d1a20-595a-495d-81df-aac615a1e77b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:08.280610 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fc2d1a20-595a-495d-81df-aac615a1e77b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:08.281031 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fc2d1a20-595a-495d-81df-aac615a1e77b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:08.384489 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-051c1e29-48d8-48f4-b66a-83939d73f8f4 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:08.392567 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-051c1e29-48d8-48f4-b66a-83939d73f8f4 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1553 microversion: 2.1 time: 0.176862 Oct 13 04:19:08.393258 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 128/255] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:08 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:08.436095 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-fc2d1a20-595a-495d-81df-aac615a1e77b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:08.444044 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-fc2d1a20-595a-495d-81df-aac615a1e77b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1497 microversion: 2.1 time: 0.175406 Oct 13 04:19:08.444597 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 128/256] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:08 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:09.152330 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-249f1140-3801-467e-b5a7-eaabe36fd370 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:09.153236 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-249f1140-3801-467e-b5a7-eaabe36fd370 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:09.159643 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-249f1140-3801-467e-b5a7-eaabe36fd370 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:09.160055 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-249f1140-3801-467e-b5a7-eaabe36fd370 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:09.160839 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-249f1140-3801-467e-b5a7-eaabe36fd370 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:09.161263 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-249f1140-3801-467e-b5a7-eaabe36fd370 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:09.171632 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-68844998-8163-49aa-9f47-e940761c153a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:09.172577 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-68844998-8163-49aa-9f47-e940761c153a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:09.180349 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-68844998-8163-49aa-9f47-e940761c153a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:09.181006 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-68844998-8163-49aa-9f47-e940761c153a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:09.182035 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-68844998-8163-49aa-9f47-e940761c153a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:09.182581 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-68844998-8163-49aa-9f47-e940761c153a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:09.235989 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-249f1140-3801-467e-b5a7-eaabe36fd370 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.086733 Oct 13 04:19:09.236746 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 129/257] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:09 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:09.241770 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f00a4c72-2e28-4a9a-ba3c-b9ff821911db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:09.242759 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f00a4c72-2e28-4a9a-ba3c-b9ff821911db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:09.249636 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f00a4c72-2e28-4a9a-ba3c-b9ff821911db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:09.250082 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f00a4c72-2e28-4a9a-ba3c-b9ff821911db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:09.250836 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f00a4c72-2e28-4a9a-ba3c-b9ff821911db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:09.251262 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f00a4c72-2e28-4a9a-ba3c-b9ff821911db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:09.252629 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-68844998-8163-49aa-9f47-e940761c153a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.084642 Oct 13 04:19:09.253345 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 129/258] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:09 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:09.280708 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f00a4c72-2e28-4a9a-ba3c-b9ff821911db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042774 Oct 13 04:19:09.281270 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 130/259] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:19:09 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:09.414990 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a76f79f6-4583-42d9-af7d-2d4632b2d559 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:09.416111 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a76f79f6-4583-42d9-af7d-2d4632b2d559 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:09.427394 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a76f79f6-4583-42d9-af7d-2d4632b2d559 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:09.428176 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a76f79f6-4583-42d9-af7d-2d4632b2d559 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:09.428938 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a76f79f6-4583-42d9-af7d-2d4632b2d559 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:09.429360 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a76f79f6-4583-42d9-af7d-2d4632b2d559 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:09.564587 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a76f79f6-4583-42d9-af7d-2d4632b2d559 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:09.573754 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a76f79f6-4583-42d9-af7d-2d4632b2d559 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1553 microversion: 2.1 time: 0.165945 Oct 13 04:19:09.574337 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 130/260] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:09 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:10.249168 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-54fbc611-d55a-4bcd-b248-61cb02009abe tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:10.250114 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-54fbc611-d55a-4bcd-b248-61cb02009abe tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:10.256785 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-54fbc611-d55a-4bcd-b248-61cb02009abe tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:10.257223 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-54fbc611-d55a-4bcd-b248-61cb02009abe tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:10.258009 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-54fbc611-d55a-4bcd-b248-61cb02009abe tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:10.258436 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-54fbc611-d55a-4bcd-b248-61cb02009abe tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:10.264446 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f557c1db-ef7e-47aa-8417-c75be16dbeaa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:10.265595 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f557c1db-ef7e-47aa-8417-c75be16dbeaa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:10.272630 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f557c1db-ef7e-47aa-8417-c75be16dbeaa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:10.273001 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f557c1db-ef7e-47aa-8417-c75be16dbeaa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:10.275870 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f557c1db-ef7e-47aa-8417-c75be16dbeaa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:10.276318 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f557c1db-ef7e-47aa-8417-c75be16dbeaa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:10.350051 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-54fbc611-d55a-4bcd-b248-61cb02009abe tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.103839 Oct 13 04:19:10.350593 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 131/261] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:10 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:10.355525 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9794ae28-13f6-4f78-bfc3-b188ca83efce tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:10.356509 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9794ae28-13f6-4f78-bfc3-b188ca83efce tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:10.359476 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f557c1db-ef7e-47aa-8417-c75be16dbeaa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.098689 Oct 13 04:19:10.360121 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 131/262] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:10 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:10.363341 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9794ae28-13f6-4f78-bfc3-b188ca83efce tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:10.363780 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9794ae28-13f6-4f78-bfc3-b188ca83efce tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:10.364536 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9794ae28-13f6-4f78-bfc3-b188ca83efce tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:10.364954 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9794ae28-13f6-4f78-bfc3-b188ca83efce tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:10.396252 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9794ae28-13f6-4f78-bfc3-b188ca83efce tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044407 Oct 13 04:19:10.396834 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 132/263] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:19:10 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:10.591775 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ddd42090-0e7c-412f-a31c-dcecc69ffcd0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:10.592452 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ddd42090-0e7c-412f-a31c-dcecc69ffcd0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:10.599692 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ddd42090-0e7c-412f-a31c-dcecc69ffcd0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:10.600312 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ddd42090-0e7c-412f-a31c-dcecc69ffcd0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:10.601000 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ddd42090-0e7c-412f-a31c-dcecc69ffcd0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:10.601425 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ddd42090-0e7c-412f-a31c-dcecc69ffcd0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:10.728141 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ddd42090-0e7c-412f-a31c-dcecc69ffcd0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:10.736335 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ddd42090-0e7c-412f-a31c-dcecc69ffcd0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1553 microversion: 2.1 time: 0.148631 Oct 13 04:19:10.736905 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 132/264] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:10 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:11.361457 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-457a971b-b18c-4767-8bee-2bea4963df9b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:11.362401 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-457a971b-b18c-4767-8bee-2bea4963df9b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:11.369470 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-457a971b-b18c-4767-8bee-2bea4963df9b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:11.369939 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-457a971b-b18c-4767-8bee-2bea4963df9b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:11.370719 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-457a971b-b18c-4767-8bee-2bea4963df9b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:11.371647 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-32b557b7-7e4f-4167-9b09-220667dc19de tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:11.372570 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-32b557b7-7e4f-4167-9b09-220667dc19de tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:11.372701 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-457a971b-b18c-4767-8bee-2bea4963df9b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:11.382590 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-32b557b7-7e4f-4167-9b09-220667dc19de tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:11.383324 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-32b557b7-7e4f-4167-9b09-220667dc19de tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:11.384483 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-32b557b7-7e4f-4167-9b09-220667dc19de tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:11.384923 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-32b557b7-7e4f-4167-9b09-220667dc19de tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:11.443637 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-457a971b-b18c-4767-8bee-2bea4963df9b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.085740 Oct 13 04:19:11.444295 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 133/265] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:11 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:11.449271 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-34ab4d39-eb0e-4d09-9aeb-e851e63288db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:11.450290 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-34ab4d39-eb0e-4d09-9aeb-e851e63288db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:11.456668 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-32b557b7-7e4f-4167-9b09-220667dc19de tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.088648 Oct 13 04:19:11.456914 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-34ab4d39-eb0e-4d09-9aeb-e851e63288db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:11.457371 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-34ab4d39-eb0e-4d09-9aeb-e851e63288db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:11.457506 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 133/266] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:11 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:11.458175 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-34ab4d39-eb0e-4d09-9aeb-e851e63288db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:11.458598 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-34ab4d39-eb0e-4d09-9aeb-e851e63288db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:11.487573 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-34ab4d39-eb0e-4d09-9aeb-e851e63288db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042107 Oct 13 04:19:11.488106 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 134/267] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:19:11 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:11.754685 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-34e23a54-0117-4a6d-b2ac-c4cf0d5e40c0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:11.755368 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-34e23a54-0117-4a6d-b2ac-c4cf0d5e40c0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:11.762117 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-34e23a54-0117-4a6d-b2ac-c4cf0d5e40c0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:11.762560 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-34e23a54-0117-4a6d-b2ac-c4cf0d5e40c0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:11.763308 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-34e23a54-0117-4a6d-b2ac-c4cf0d5e40c0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:11.763727 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-34e23a54-0117-4a6d-b2ac-c4cf0d5e40c0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:11.904936 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-34e23a54-0117-4a6d-b2ac-c4cf0d5e40c0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:11.914872 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-34e23a54-0117-4a6d-b2ac-c4cf0d5e40c0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1553 microversion: 2.1 time: 0.164363 Oct 13 04:19:11.916840 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 134/268] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:11 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:12.459351 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-cf5b23a5-f109-4eae-80d4-ae25625a63ce tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:12.460373 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-cf5b23a5-f109-4eae-80d4-ae25625a63ce tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:12.467004 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cf5b23a5-f109-4eae-80d4-ae25625a63ce tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:12.467444 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cf5b23a5-f109-4eae-80d4-ae25625a63ce tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:12.468196 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cf5b23a5-f109-4eae-80d4-ae25625a63ce tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:12.468449 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-973be10a-4248-4548-b0ba-54780b6fd27a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:12.468894 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cf5b23a5-f109-4eae-80d4-ae25625a63ce tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:12.469395 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-973be10a-4248-4548-b0ba-54780b6fd27a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:12.475630 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-973be10a-4248-4548-b0ba-54780b6fd27a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:12.476084 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-973be10a-4248-4548-b0ba-54780b6fd27a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:12.476869 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-973be10a-4248-4548-b0ba-54780b6fd27a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:12.477296 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-973be10a-4248-4548-b0ba-54780b6fd27a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:20.675249 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-973be10a-4248-4548-b0ba-54780b6fd27a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 8.210317 Oct 13 04:19:20.675901 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 135/269] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:12 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 8212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:20.681391 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-cf5b23a5-f109-4eae-80d4-ae25625a63ce tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 8.227930 Oct 13 04:19:20.681904 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0cfdabf4-100d-4672-a412-fbcb8ecbd5b1 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:20.682462 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0cfdabf4-100d-4672-a412-fbcb8ecbd5b1 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:20.683151 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 135/270] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:12 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 8231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:20.690813 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1b1c7084-a052-4e0b-8854-4af7506b33e2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:20.691003 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0cfdabf4-100d-4672-a412-fbcb8ecbd5b1 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:20.691330 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0cfdabf4-100d-4672-a412-fbcb8ecbd5b1 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:20.691987 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-1b1c7084-a052-4e0b-8854-4af7506b33e2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:20.692631 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0cfdabf4-100d-4672-a412-fbcb8ecbd5b1 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:20.693208 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0cfdabf4-100d-4672-a412-fbcb8ecbd5b1 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:20.699837 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1b1c7084-a052-4e0b-8854-4af7506b33e2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:20.700413 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1b1c7084-a052-4e0b-8854-4af7506b33e2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:20.701220 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1b1c7084-a052-4e0b-8854-4af7506b33e2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:20.702001 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1b1c7084-a052-4e0b-8854-4af7506b33e2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:20.728803 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0cfdabf4-100d-4672-a412-fbcb8ecbd5b1 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051328 Oct 13 04:19:20.731452 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 136/271] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:19:20 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:20.925150 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-1b1c7084-a052-4e0b-8854-4af7506b33e2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:20.933340 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-1b1c7084-a052-4e0b-8854-4af7506b33e2 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1553 microversion: 2.1 time: 0.248074 Oct 13 04:19:20.934069 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 136/272] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:20 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1553 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:21.306241 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-aa41495a-5f4f-4d14-857a-e59d034ec35c req-3f018922-51f7-4f17-bc99-c3dcbb11829c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ddad073-1d60-49aa-808b-97fd2684790f", "name": "network-vif-deleted", "tag": "02af8261-af42-436d-81a0-3ab22dbcea77"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:21.307815 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:19:21.307815 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:19:21.314853 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-aa41495a-5f4f-4d14-857a-e59d034ec35c req-3f018922-51f7-4f17-bc99-c3dcbb11829c service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:21.315294 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-aa41495a-5f4f-4d14-857a-e59d034ec35c req-3f018922-51f7-4f17-bc99-c3dcbb11829c service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:21.326410 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-aa41495a-5f4f-4d14-857a-e59d034ec35c req-3f018922-51f7-4f17-bc99-c3dcbb11829c service nova] Creating event network-vif-deleted:02af8261-af42-436d-81a0-3ab22dbcea77 for instance 0ddad073-1d60-49aa-808b-97fd2684790f on hv-cinder-81275 Oct 13 04:19:21.327966 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7a872177-3444-439f-bcf5-897ee37612ac tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:21.328444 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7a872177-3444-439f-bcf5-897ee37612ac tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:21.331608 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-aa41495a-5f4f-4d14-857a-e59d034ec35c req-3f018922-51f7-4f17-bc99-c3dcbb11829c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029228 Oct 13 04:19:21.332369 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 137/273] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:19:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:21.335591 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7a872177-3444-439f-bcf5-897ee37612ac tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:21.336161 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7a872177-3444-439f-bcf5-897ee37612ac tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:21.336958 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7a872177-3444-439f-bcf5-897ee37612ac tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:21.337416 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7a872177-3444-439f-bcf5-897ee37612ac tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:21.366580 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7a872177-3444-439f-bcf5-897ee37612ac tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Going to try to terminate instance {{(pid=108260) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:19:21.456027 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7a872177-3444-439f-bcf5-897ee37612ac tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "DELETE /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 204 len: 0 microversion: 2.1 time: 0.131224 Oct 13 04:19:21.459959 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 137/274] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:19:21 2021] DELETE /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 04:19:21.466067 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-00a0563e-53de-4407-883c-2a16b2f32968 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:21.467017 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-00a0563e-53de-4407-883c-2a16b2f32968 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:21.474078 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-00a0563e-53de-4407-883c-2a16b2f32968 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:21.474551 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-00a0563e-53de-4407-883c-2a16b2f32968 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:21.475302 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-00a0563e-53de-4407-883c-2a16b2f32968 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:21.475726 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-00a0563e-53de-4407-883c-2a16b2f32968 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:21.610819 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-00a0563e-53de-4407-883c-2a16b2f32968 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:21.617989 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-00a0563e-53de-4407-883c-2a16b2f32968 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1503 microversion: 2.1 time: 0.156360 Oct 13 04:19:21.618576 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 138/275] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:21 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:21.688144 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-50ace783-edcb-4365-9c7a-ed1c6ea93c52 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:21.689212 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-50ace783-edcb-4365-9c7a-ed1c6ea93c52 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:21.692104 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a0c9c50e-1982-4999-a7c3-91878e970275 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:21.693125 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a0c9c50e-1982-4999-a7c3-91878e970275 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:21.695397 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-50ace783-edcb-4365-9c7a-ed1c6ea93c52 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:21.696247 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-50ace783-edcb-4365-9c7a-ed1c6ea93c52 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:21.697021 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-50ace783-edcb-4365-9c7a-ed1c6ea93c52 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:21.697593 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-50ace783-edcb-4365-9c7a-ed1c6ea93c52 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:21.699402 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a0c9c50e-1982-4999-a7c3-91878e970275 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:21.700311 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a0c9c50e-1982-4999-a7c3-91878e970275 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:21.701350 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a0c9c50e-1982-4999-a7c3-91878e970275 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:21.701944 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a0c9c50e-1982-4999-a7c3-91878e970275 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:21.786928 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-50ace783-edcb-4365-9c7a-ed1c6ea93c52 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.102829 Oct 13 04:19:21.791438 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 138/276] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:21 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:21.793148 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2a704898-0873-4e7f-b3d5-861fed1fd89f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:21.794151 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-2a704898-0873-4e7f-b3d5-861fed1fd89f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:21.800801 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2a704898-0873-4e7f-b3d5-861fed1fd89f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:21.801236 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2a704898-0873-4e7f-b3d5-861fed1fd89f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:21.802021 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2a704898-0873-4e7f-b3d5-861fed1fd89f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:21.802443 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2a704898-0873-4e7f-b3d5-861fed1fd89f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:21.806334 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a0c9c50e-1982-4999-a7c3-91878e970275 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.117629 Oct 13 04:19:21.807258 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 139/277] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:21 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:21.832994 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-2a704898-0873-4e7f-b3d5-861fed1fd89f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043591 Oct 13 04:19:21.833693 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 139/278] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:19:21 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:19:21.951046 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0f09b1b4-45b7-4e70-bbd0-b63aaf423be8 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:21.951764 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0f09b1b4-45b7-4e70-bbd0-b63aaf423be8 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:21.958373 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f09b1b4-45b7-4e70-bbd0-b63aaf423be8 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:21.958822 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f09b1b4-45b7-4e70-bbd0-b63aaf423be8 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:21.959589 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f09b1b4-45b7-4e70-bbd0-b63aaf423be8 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:21.960007 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f09b1b4-45b7-4e70-bbd0-b63aaf423be8 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:22.017651 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f8e41dae-e89f-4127-aad8-f2ac26c139bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-57849569", "imageRef": "4f468f34-171a-4b6e-a0cd-2e4c6fcda23d", "flavorRef": "452", "networks": [{"uuid": "0d1ab067-7575-4c07-97ac-3bce9cca9c59"}]}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:22.022563 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-0f09b1b4-45b7-4e70-bbd0-b63aaf423be8 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:22.030695 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0f09b1b4-45b7-4e70-bbd0-b63aaf423be8 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1345 microversion: 2.1 time: 0.083765 Oct 13 04:19:22.031263 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 140/279] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:21 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:22.070686 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.network.neutron [None req-f8e41dae-e89f-4127-aad8-f2ac26c139bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] validate_networks() for [('0d1ab067-7575-4c07-97ac-3bce9cca9c59', None, None, None, None, None)] {{(pid=108260) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:19:22.439616 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-f8e41dae-e89f-4127-aad8-f2ac26c139bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Flavor limits 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:19:22.440010 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-f8e41dae-e89f-4127-aad8-f2ac26c139bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Image limits 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:19:22.440466 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-f8e41dae-e89f-4127-aad8-f2ac26c139bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Flavor pref 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:19:22.440891 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-f8e41dae-e89f-4127-aad8-f2ac26c139bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Image pref 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:19:22.441317 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-f8e41dae-e89f-4127-aad8-f2ac26c139bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:19:22.450107 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f8e41dae-e89f-4127-aad8-f2ac26c139bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:22.450546 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f8e41dae-e89f-4127-aad8-f2ac26c139bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:22.451330 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f8e41dae-e89f-4127-aad8-f2ac26c139bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:22.451755 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f8e41dae-e89f-4127-aad8-f2ac26c139bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:22.469486 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-f8e41dae-e89f-4127-aad8-f2ac26c139bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Getting quotas for project f6806325e2e94089a6944698ad9b7808. Resources: {'ram', 'cores', 'instances'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:19:22.473675 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-f8e41dae-e89f-4127-aad8-f2ac26c139bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Getting quotas for user 9d3f110a789d432d85e185decef26aea and project f6806325e2e94089a6944698ad9b7808. Resources: {'ram', 'cores', 'instances'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:19:22.484781 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f8e41dae-e89f-4127-aad8-f2ac26c139bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Going to run 1 instances... {{(pid=108260) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:19:22.487132 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f8e41dae-e89f-4127-aad8-f2ac26c139bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f468f34-171a-4b6e-a0cd-2e4c6fcda23d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:19:22.537954 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f8e41dae-e89f-4127-aad8-f2ac26c139bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523926 Oct 13 04:19:22.538966 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 140/280] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Oct 13 04:19:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 04:19:22.549632 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1849861d-ac83-473e-88a5-c7f7781b6808 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:22.550347 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1849861d-ac83-473e-88a5-c7f7781b6808 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:22.602913 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1849861d-ac83-473e-88a5-c7f7781b6808 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:22.609657 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1849861d-ac83-473e-88a5-c7f7781b6808 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1216 microversion: 2.1 time: 0.063673 Oct 13 04:19:22.610232 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 141/281] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:22 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1216 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:22.637395 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-fb4c6769-56fe-42e9-a609-5e78c0d53e16 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:22.638204 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-fb4c6769-56fe-42e9-a609-5e78c0d53e16 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:22.644788 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fb4c6769-56fe-42e9-a609-5e78c0d53e16 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:22.645269 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fb4c6769-56fe-42e9-a609-5e78c0d53e16 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:22.646196 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fb4c6769-56fe-42e9-a609-5e78c0d53e16 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:22.646619 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fb4c6769-56fe-42e9-a609-5e78c0d53e16 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:22.792793 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-fb4c6769-56fe-42e9-a609-5e78c0d53e16 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:22.798955 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-6e878359-ca71-4174-ad57-704e00e61d16 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:22.800049 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-6e878359-ca71-4174-ad57-704e00e61d16 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:22.802543 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-fb4c6769-56fe-42e9-a609-5e78c0d53e16 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1503 microversion: 2.1 time: 0.170626 Oct 13 04:19:22.803919 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 141/282] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:22 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:22.806244 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6e878359-ca71-4174-ad57-704e00e61d16 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:22.806677 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6e878359-ca71-4174-ad57-704e00e61d16 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:22.807501 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6e878359-ca71-4174-ad57-704e00e61d16 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:22.808104 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6e878359-ca71-4174-ad57-704e00e61d16 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:22.817506 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-dd06833b-8412-4da3-8998-120fd6af0229 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:22.818512 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-dd06833b-8412-4da3-8998-120fd6af0229 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:22.828181 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dd06833b-8412-4da3-8998-120fd6af0229 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:22.828843 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dd06833b-8412-4da3-8998-120fd6af0229 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:22.829769 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dd06833b-8412-4da3-8998-120fd6af0229 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:22.830785 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dd06833b-8412-4da3-8998-120fd6af0229 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:22.900848 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-6e878359-ca71-4174-ad57-704e00e61d16 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.105670 Oct 13 04:19:22.904864 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 142/283] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:22 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:22.940342 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-dd06833b-8412-4da3-8998-120fd6af0229 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.126229 Oct 13 04:19:22.941404 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 142/284] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:22 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:19:23.048182 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-62bc7f45-c760-4351-adf8-18086b1b386d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:23.048862 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-62bc7f45-c760-4351-adf8-18086b1b386d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:23.059386 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62bc7f45-c760-4351-adf8-18086b1b386d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:23.059820 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62bc7f45-c760-4351-adf8-18086b1b386d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:23.060583 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62bc7f45-c760-4351-adf8-18086b1b386d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:23.061000 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62bc7f45-c760-4351-adf8-18086b1b386d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:23.092324 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62bc7f45-c760-4351-adf8-18086b1b386d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:23.092760 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62bc7f45-c760-4351-adf8-18086b1b386d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:23.093211 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-62bc7f45-c760-4351-adf8-18086b1b386d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lazy-loading 'fault' on Instance uuid 0ddad073-1d60-49aa-808b-97fd2684790f {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:19:23.135685 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-62bc7f45-c760-4351-adf8-18086b1b386d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aabc6e5e816429cb88496a128d5b9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d531b9d4b7c47ca9168806481e36699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:23.143175 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-62bc7f45-c760-4351-adf8-18086b1b386d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 200 len: 1350 microversion: 2.1 time: 0.099056 Oct 13 04:19:23.143767 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 143/285] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:23 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:23.627266 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-54f22ea8-c7b1-4a23-b5e6-ef81e43b7d3d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:23.627952 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-54f22ea8-c7b1-4a23-b5e6-ef81e43b7d3d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:23.634694 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-54f22ea8-c7b1-4a23-b5e6-ef81e43b7d3d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:23.635129 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-54f22ea8-c7b1-4a23-b5e6-ef81e43b7d3d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:23.635933 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-54f22ea8-c7b1-4a23-b5e6-ef81e43b7d3d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:23.636387 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-54f22ea8-c7b1-4a23-b5e6-ef81e43b7d3d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:23.696456 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-54f22ea8-c7b1-4a23-b5e6-ef81e43b7d3d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:23.704012 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-54f22ea8-c7b1-4a23-b5e6-ef81e43b7d3d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1268 microversion: 2.1 time: 0.080826 Oct 13 04:19:23.704584 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 143/286] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:23 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1268 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:23.820512 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-bcb15e9a-177e-40a1-a738-ebc8ea353fcf tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:23.821143 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-bcb15e9a-177e-40a1-a738-ebc8ea353fcf tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:23.830442 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bcb15e9a-177e-40a1-a738-ebc8ea353fcf tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:23.830887 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bcb15e9a-177e-40a1-a738-ebc8ea353fcf tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:23.831662 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bcb15e9a-177e-40a1-a738-ebc8ea353fcf tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:23.832090 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bcb15e9a-177e-40a1-a738-ebc8ea353fcf tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:23.912551 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-70e92425-3bb0-4c91-8338-78076c04e929 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:23.913944 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-70e92425-3bb0-4c91-8338-78076c04e929 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:23.920452 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-70e92425-3bb0-4c91-8338-78076c04e929 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:23.921196 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-70e92425-3bb0-4c91-8338-78076c04e929 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:23.927750 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-70e92425-3bb0-4c91-8338-78076c04e929 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:23.928429 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-70e92425-3bb0-4c91-8338-78076c04e929 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:23.958082 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-bcb15e9a-177e-40a1-a738-ebc8ea353fcf tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:23.965872 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-bcb15e9a-177e-40a1-a738-ebc8ea353fcf tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1503 microversion: 2.1 time: 0.149306 Oct 13 04:19:23.966410 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 144/287] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:23 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:23.970868 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-773bb3b0-ca43-4608-92aa-ae0a2670afdc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:23.971769 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-773bb3b0-ca43-4608-92aa-ae0a2670afdc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:23.978576 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-773bb3b0-ca43-4608-92aa-ae0a2670afdc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:23.979019 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-773bb3b0-ca43-4608-92aa-ae0a2670afdc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:23.979803 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-773bb3b0-ca43-4608-92aa-ae0a2670afdc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:23.980228 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-773bb3b0-ca43-4608-92aa-ae0a2670afdc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:24.062044 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-70e92425-3bb0-4c91-8338-78076c04e929 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.153041 Oct 13 04:19:24.062984 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 144/288] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:23 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:24.103010 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-773bb3b0-ca43-4608-92aa-ae0a2670afdc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.135311 Oct 13 04:19:24.103996 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 145/289] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:23 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:24.173148 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6380e5d5-3b05-47cc-80a1-12ffc605399b tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:24.176462 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6380e5d5-3b05-47cc-80a1-12ffc605399b tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:24.185475 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6380e5d5-3b05-47cc-80a1-12ffc605399b tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:24.190080 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6380e5d5-3b05-47cc-80a1-12ffc605399b tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:24.191319 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6380e5d5-3b05-47cc-80a1-12ffc605399b tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:24.192414 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6380e5d5-3b05-47cc-80a1-12ffc605399b tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:24.210618 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-6380e5d5-3b05-47cc-80a1-12ffc605399b tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] HTTP exception thrown: Instance 0ddad073-1d60-49aa-808b-97fd2684790f could not be found. Oct 13 04:19:24.211257 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6380e5d5-3b05-47cc-80a1-12ffc605399b tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Returning 404 to user: Instance 0ddad073-1d60-49aa-808b-97fd2684790f could not be found. {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:19:24.212211 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6380e5d5-3b05-47cc-80a1-12ffc605399b tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 404 len: 111 microversion: 2.1 time: 0.055843 Oct 13 04:19:24.212978 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 145/290] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:24 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:19:24.332372 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0f1e102d-7738-4dde-a50b-e7cecad9a9e0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:24.333770 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0f1e102d-7738-4dde-a50b-e7cecad9a9e0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:24.340750 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f1e102d-7738-4dde-a50b-e7cecad9a9e0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:24.341183 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f1e102d-7738-4dde-a50b-e7cecad9a9e0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:24.341989 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f1e102d-7738-4dde-a50b-e7cecad9a9e0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:24.342405 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f1e102d-7738-4dde-a50b-e7cecad9a9e0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:24.354911 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-0f1e102d-7738-4dde-a50b-e7cecad9a9e0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] HTTP exception thrown: Instance 0ddad073-1d60-49aa-808b-97fd2684790f could not be found. Oct 13 04:19:24.355556 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0f1e102d-7738-4dde-a50b-e7cecad9a9e0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Returning 404 to user: Instance 0ddad073-1d60-49aa-808b-97fd2684790f could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:19:24.356378 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0f1e102d-7738-4dde-a50b-e7cecad9a9e0 tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028806 Oct 13 04:19:24.356915 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 146/291] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:19:24 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:19:24.726007 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f582e6ef-40e8-47ce-8997-ef0fe12d9f8c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:24.726603 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f582e6ef-40e8-47ce-8997-ef0fe12d9f8c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:24.733153 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f582e6ef-40e8-47ce-8997-ef0fe12d9f8c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:24.733645 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f582e6ef-40e8-47ce-8997-ef0fe12d9f8c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:24.734443 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f582e6ef-40e8-47ce-8997-ef0fe12d9f8c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:24.734859 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f582e6ef-40e8-47ce-8997-ef0fe12d9f8c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:24.815373 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f582e6ef-40e8-47ce-8997-ef0fe12d9f8c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:24.824351 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f582e6ef-40e8-47ce-8997-ef0fe12d9f8c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1274 microversion: 2.1 time: 0.101975 Oct 13 04:19:24.825048 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 146/292] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:24 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1274 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:24.984152 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-946595a6-17ec-4e01-9347-8329566744a3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:24.984733 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-946595a6-17ec-4e01-9347-8329566744a3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:24.991487 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-946595a6-17ec-4e01-9347-8329566744a3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:24.993081 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-946595a6-17ec-4e01-9347-8329566744a3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:24.994359 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-946595a6-17ec-4e01-9347-8329566744a3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:24.994857 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-946595a6-17ec-4e01-9347-8329566744a3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:25.074024 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2cc623c5-c380-43c8-8eb0-ce01191ff3c4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:25.075008 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-2cc623c5-c380-43c8-8eb0-ce01191ff3c4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:25.080912 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2cc623c5-c380-43c8-8eb0-ce01191ff3c4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:25.081352 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2cc623c5-c380-43c8-8eb0-ce01191ff3c4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:25.082141 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2cc623c5-c380-43c8-8eb0-ce01191ff3c4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:25.082566 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2cc623c5-c380-43c8-8eb0-ce01191ff3c4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:25.112858 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-946595a6-17ec-4e01-9347-8329566744a3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:25.120903 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-946595a6-17ec-4e01-9347-8329566744a3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 200 len: 1461 microversion: 2.1 time: 0.140625 Oct 13 04:19:25.121483 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 147/293] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:24 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 1461 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:25.126578 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-de88ad87-2cd8-404b-8556-84ccd24f54fe req-6864d4bc-0e35-4455-8575-2b718749660d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcdcd661-b52b-470d-838a-fab934cb3f15", "name": "network-vif-deleted", "tag": "ea758bd2-3fff-4b91-8658-250e948b8fdb"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:25.128147 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:19:25.128147 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:19:25.137850 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-de88ad87-2cd8-404b-8556-84ccd24f54fe req-6864d4bc-0e35-4455-8575-2b718749660d service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:25.138449 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-de88ad87-2cd8-404b-8556-84ccd24f54fe req-6864d4bc-0e35-4455-8575-2b718749660d service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:25.150893 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-de88ad87-2cd8-404b-8556-84ccd24f54fe req-6864d4bc-0e35-4455-8575-2b718749660d service nova] Creating event network-vif-deleted:ea758bd2-3fff-4b91-8658-250e948b8fdb for instance dcdcd661-b52b-470d-838a-fab934cb3f15 on hv-cinder-81275 Oct 13 04:19:25.156200 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-de88ad87-2cd8-404b-8556-84ccd24f54fe req-6864d4bc-0e35-4455-8575-2b718749660d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033251 Oct 13 04:19:25.156815 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 148/294] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:19:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:25.162214 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-59ae100f-5c03-43f6-834f-de95b8e6ca8e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:25.163630 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-59ae100f-5c03-43f6-834f-de95b8e6ca8e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:25.173396 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-59ae100f-5c03-43f6-834f-de95b8e6ca8e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:25.174045 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-59ae100f-5c03-43f6-834f-de95b8e6ca8e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:25.174774 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-59ae100f-5c03-43f6-834f-de95b8e6ca8e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:25.175232 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-59ae100f-5c03-43f6-834f-de95b8e6ca8e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:25.262627 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-59ae100f-5c03-43f6-834f-de95b8e6ca8e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.104332 Oct 13 04:19:25.263558 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 149/295] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:25 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:25.341843 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-2cc623c5-c380-43c8-8eb0-ce01191ff3c4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.271348 Oct 13 04:19:25.343749 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 147/296] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:25 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:25.565357 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-acd3e0f3-a9a3-4636-a808-dc101892969d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:25.566341 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-acd3e0f3-a9a3-4636-a808-dc101892969d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:25.573988 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-acd3e0f3-a9a3-4636-a808-dc101892969d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:25.574405 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-acd3e0f3-a9a3-4636-a808-dc101892969d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:25.575171 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-acd3e0f3-a9a3-4636-a808-dc101892969d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:25.575594 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-acd3e0f3-a9a3-4636-a808-dc101892969d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:25.589158 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-acd3e0f3-a9a3-4636-a808-dc101892969d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] HTTP exception thrown: Instance 0ddad073-1d60-49aa-808b-97fd2684790f could not be found. Oct 13 04:19:25.589842 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-acd3e0f3-a9a3-4636-a808-dc101892969d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Returning 404 to user: Instance 0ddad073-1d60-49aa-808b-97fd2684790f could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:19:25.590677 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-acd3e0f3-a9a3-4636-a808-dc101892969d tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "DELETE /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 404 len: 111 microversion: 2.1 time: 0.029431 Oct 13 04:19:25.591202 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 150/297] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:19:25 2021] DELETE /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 04:19:25.599707 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-01e57748-8aa7-42d7-96f3-901ac90d7e7c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:25.600421 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-01e57748-8aa7-42d7-96f3-901ac90d7e7c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] [instance: 0ddad073-1d60-49aa-808b-97fd2684790f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:25.606980 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-01e57748-8aa7-42d7-96f3-901ac90d7e7c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:25.607418 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-01e57748-8aa7-42d7-96f3-901ac90d7e7c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:25.608171 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-01e57748-8aa7-42d7-96f3-901ac90d7e7c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:25.608589 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-01e57748-8aa7-42d7-96f3-901ac90d7e7c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:25.621900 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-01e57748-8aa7-42d7-96f3-901ac90d7e7c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] HTTP exception thrown: Instance 0ddad073-1d60-49aa-808b-97fd2684790f could not be found. Oct 13 04:19:25.622491 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-01e57748-8aa7-42d7-96f3-901ac90d7e7c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] Returning 404 to user: Instance 0ddad073-1d60-49aa-808b-97fd2684790f could not be found. {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:19:25.623621 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-01e57748-8aa7-42d7-96f3-901ac90d7e7c tempest-DeleteServersTestJSON-1979417967 tempest-DeleteServersTestJSON-1979417967-project] 10.222.0.55 "GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f" status: 404 len: 111 microversion: 2.1 time: 0.027733 Oct 13 04:19:25.624515 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 148/298] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:25 2021] GET /compute/v2.1/servers/0ddad073-1d60-49aa-808b-97fd2684790f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:19:25.847497 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-052968ff-6eaf-4b9f-b5b5-7c17b9d1252f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:25.848379 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-052968ff-6eaf-4b9f-b5b5-7c17b9d1252f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:25.864037 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-052968ff-6eaf-4b9f-b5b5-7c17b9d1252f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:25.864696 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-052968ff-6eaf-4b9f-b5b5-7c17b9d1252f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:25.866303 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-052968ff-6eaf-4b9f-b5b5-7c17b9d1252f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:25.867042 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-052968ff-6eaf-4b9f-b5b5-7c17b9d1252f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:26.128816 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-052968ff-6eaf-4b9f-b5b5-7c17b9d1252f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:26.136874 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-052968ff-6eaf-4b9f-b5b5-7c17b9d1252f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1316 microversion: 2.1 time: 0.294547 Oct 13 04:19:26.137432 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 151/299] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:25 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:26.140344 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-85aa7888-ecca-48a4-b86d-dccfd3ae78e3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:26.140344 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-85aa7888-ecca-48a4-b86d-dccfd3ae78e3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: dcdcd661-b52b-470d-838a-fab934cb3f15] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:26.146809 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-85aa7888-ecca-48a4-b86d-dccfd3ae78e3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:26.147256 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-85aa7888-ecca-48a4-b86d-dccfd3ae78e3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:26.148022 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-85aa7888-ecca-48a4-b86d-dccfd3ae78e3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:26.148446 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-85aa7888-ecca-48a4-b86d-dccfd3ae78e3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:26.161818 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-85aa7888-ecca-48a4-b86d-dccfd3ae78e3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] HTTP exception thrown: Instance dcdcd661-b52b-470d-838a-fab934cb3f15 could not be found. Oct 13 04:19:26.162816 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-85aa7888-ecca-48a4-b86d-dccfd3ae78e3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Returning 404 to user: Instance dcdcd661-b52b-470d-838a-fab934cb3f15 could not be found. {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:19:26.164136 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-85aa7888-ecca-48a4-b86d-dccfd3ae78e3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15" status: 404 len: 111 microversion: 2.1 time: 0.029992 Oct 13 04:19:26.164666 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 149/300] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:26 2021] GET /compute/v2.1/servers/dcdcd661-b52b-470d-838a-fab934cb3f15 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:19:26.262386 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4f798967-831d-42e4-bc2f-2192178504fc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1358021624", "imageRef": "4f468f34-171a-4b6e-a0cd-2e4c6fcda23d", "flavorRef": "452", "networks": [{"uuid": "37641152-c7d0-4e3b-b8b6-cb9f4932709d"}]}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:26.274667 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7d88d575-8913-45f3-a75f-c417bae9bf4d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:26.275881 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7d88d575-8913-45f3-a75f-c417bae9bf4d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:26.283310 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7d88d575-8913-45f3-a75f-c417bae9bf4d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:26.283754 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7d88d575-8913-45f3-a75f-c417bae9bf4d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:26.284738 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7d88d575-8913-45f3-a75f-c417bae9bf4d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:26.285171 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7d88d575-8913-45f3-a75f-c417bae9bf4d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:26.325367 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.network.neutron [None req-4f798967-831d-42e4-bc2f-2192178504fc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] validate_networks() for [('37641152-c7d0-4e3b-b8b6-cb9f4932709d', None, None, None, None, None)] {{(pid=108259) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:19:26.386548 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7d88d575-8913-45f3-a75f-c417bae9bf4d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.115302 Oct 13 04:19:26.391514 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 150/301] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:26 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:26.398507 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ab895c19-3e19-40b7-937b-d7a4766c03c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:26.408778 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ab895c19-3e19-40b7-937b-d7a4766c03c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:26.415907 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ab895c19-3e19-40b7-937b-d7a4766c03c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:26.416553 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ab895c19-3e19-40b7-937b-d7a4766c03c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:26.417504 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ab895c19-3e19-40b7-937b-d7a4766c03c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:26.418112 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ab895c19-3e19-40b7-937b-d7a4766c03c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:26.517112 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ab895c19-3e19-40b7-937b-d7a4766c03c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.123907 Oct 13 04:19:26.518737 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 151/302] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:26 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:26.870370 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-4f798967-831d-42e4-bc2f-2192178504fc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Flavor limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:19:26.871610 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-4f798967-831d-42e4-bc2f-2192178504fc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Image limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:19:26.873634 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-4f798967-831d-42e4-bc2f-2192178504fc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Flavor pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:19:26.874126 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-4f798967-831d-42e4-bc2f-2192178504fc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Image pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:19:26.874542 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-4f798967-831d-42e4-bc2f-2192178504fc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:19:26.888172 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4f798967-831d-42e4-bc2f-2192178504fc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:26.888798 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4f798967-831d-42e4-bc2f-2192178504fc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:26.897747 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4f798967-831d-42e4-bc2f-2192178504fc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:26.898225 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4f798967-831d-42e4-bc2f-2192178504fc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:26.923099 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-4f798967-831d-42e4-bc2f-2192178504fc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Getting quotas for project 09d2cdcae4c64be48feb38880725cda1. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:19:26.930092 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-4f798967-831d-42e4-bc2f-2192178504fc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Getting quotas for user 6739d1337a744567827491ebc371f05f and project 09d2cdcae4c64be48feb38880725cda1. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:19:26.954067 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4f798967-831d-42e4-bc2f-2192178504fc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Going to run 1 instances... {{(pid=108259) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:19:26.956482 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4f798967-831d-42e4-bc2f-2192178504fc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f468f34-171a-4b6e-a0cd-2e4c6fcda23d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:19:27.016992 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4f798967-831d-42e4-bc2f-2192178504fc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758660 Oct 13 04:19:27.022967 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 152/303] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Oct 13 04:19:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 04:19:27.028516 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-dd5a099f-8899-4ef2-a7f1-ddc6a0cc9e58 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:27.029212 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-dd5a099f-8899-4ef2-a7f1-ddc6a0cc9e58 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:27.117352 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-dd5a099f-8899-4ef2-a7f1-ddc6a0cc9e58 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:27.127213 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-dd5a099f-8899-4ef2-a7f1-ddc6a0cc9e58 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1214 microversion: 2.1 time: 0.102406 Oct 13 04:19:27.127512 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 152/304] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:27 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:27.154457 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-cd63161a-e704-421c-a1aa-4c950a895b97 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:27.155061 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-cd63161a-e704-421c-a1aa-4c950a895b97 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:27.163732 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cd63161a-e704-421c-a1aa-4c950a895b97 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:27.164465 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cd63161a-e704-421c-a1aa-4c950a895b97 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:27.165189 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cd63161a-e704-421c-a1aa-4c950a895b97 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:27.165655 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cd63161a-e704-421c-a1aa-4c950a895b97 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:27.216095 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-a6d99017-080c-4133-a89f-14c61e36d210 req-a4c64d2b-42f0-46d1-9227-b47b958d6b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d58316e9-818c-4986-9148-932d51f34cc9", "tag": "355dc108-256f-4efe-8035-feb0a826461d"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:27.217965 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:19:27.217965 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:19:27.230291 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-a6d99017-080c-4133-a89f-14c61e36d210 req-a4c64d2b-42f0-46d1-9227-b47b958d6b88 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:27.230756 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-a6d99017-080c-4133-a89f-14c61e36d210 req-a4c64d2b-42f0-46d1-9227-b47b958d6b88 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:27.242362 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-a6d99017-080c-4133-a89f-14c61e36d210 req-a4c64d2b-42f0-46d1-9227-b47b958d6b88 service nova] Creating event network-changed:355dc108-256f-4efe-8035-feb0a826461d for instance d58316e9-818c-4986-9148-932d51f34cc9 on hv-cinder-81275 Oct 13 04:19:27.248899 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-a6d99017-080c-4133-a89f-14c61e36d210 req-a4c64d2b-42f0-46d1-9227-b47b958d6b88 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036131 Oct 13 04:19:27.250277 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 153/305] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:19:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:19:27.399755 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3638bcc1-50c4-46fe-9fe0-307ecd111473 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:27.400966 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3638bcc1-50c4-46fe-9fe0-307ecd111473 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:27.411513 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3638bcc1-50c4-46fe-9fe0-307ecd111473 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:27.413489 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3638bcc1-50c4-46fe-9fe0-307ecd111473 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:27.416826 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3638bcc1-50c4-46fe-9fe0-307ecd111473 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:27.419804 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3638bcc1-50c4-46fe-9fe0-307ecd111473 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:27.488260 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-cd63161a-e704-421c-a1aa-4c950a895b97 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:27.497483 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-cd63161a-e704-421c-a1aa-4c950a895b97 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1316 microversion: 2.1 time: 0.346921 Oct 13 04:19:27.501811 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 153/306] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:27 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:27.529503 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c53ee99e-d1f1-4e2a-87f5-2bfc06cfd638 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:27.530522 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c53ee99e-d1f1-4e2a-87f5-2bfc06cfd638 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:27.539473 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c53ee99e-d1f1-4e2a-87f5-2bfc06cfd638 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:27.539980 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c53ee99e-d1f1-4e2a-87f5-2bfc06cfd638 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:27.541076 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c53ee99e-d1f1-4e2a-87f5-2bfc06cfd638 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:27.541723 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c53ee99e-d1f1-4e2a-87f5-2bfc06cfd638 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:27.565503 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3638bcc1-50c4-46fe-9fe0-307ecd111473 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.169663 Oct 13 04:19:27.566931 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 154/307] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:27 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:19:27.635130 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c53ee99e-d1f1-4e2a-87f5-2bfc06cfd638 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.109867 Oct 13 04:19:27.635873 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 154/308] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:27 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:19:28.152402 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-520130bd-0b37-4c62-9e5f-fb03d0c0efc2 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:28.153120 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-520130bd-0b37-4c62-9e5f-fb03d0c0efc2 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:28.159995 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-520130bd-0b37-4c62-9e5f-fb03d0c0efc2 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:28.160367 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-520130bd-0b37-4c62-9e5f-fb03d0c0efc2 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:28.161113 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-520130bd-0b37-4c62-9e5f-fb03d0c0efc2 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:28.161518 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-520130bd-0b37-4c62-9e5f-fb03d0c0efc2 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:28.226783 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-520130bd-0b37-4c62-9e5f-fb03d0c0efc2 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:28.234622 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-520130bd-0b37-4c62-9e5f-fb03d0c0efc2 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1266 microversion: 2.1 time: 0.092125 Oct 13 04:19:28.245153 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 155/309] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:28 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:28.515300 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-07c6c1ea-8db0-46ac-9ac4-c0465dab9836 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:28.516006 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-07c6c1ea-8db0-46ac-9ac4-c0465dab9836 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:28.528194 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-07c6c1ea-8db0-46ac-9ac4-c0465dab9836 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:28.528706 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-07c6c1ea-8db0-46ac-9ac4-c0465dab9836 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:28.534449 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-07c6c1ea-8db0-46ac-9ac4-c0465dab9836 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:28.535171 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-07c6c1ea-8db0-46ac-9ac4-c0465dab9836 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:28.578627 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7f400865-a836-4bf5-94d1-22acd242b183 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:28.579812 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7f400865-a836-4bf5-94d1-22acd242b183 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:28.586347 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7f400865-a836-4bf5-94d1-22acd242b183 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:28.587016 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7f400865-a836-4bf5-94d1-22acd242b183 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:28.588168 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7f400865-a836-4bf5-94d1-22acd242b183 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:28.588801 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7f400865-a836-4bf5-94d1-22acd242b183 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:28.814804 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-07c6c1ea-8db0-46ac-9ac4-c0465dab9836 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:28.830933 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-07c6c1ea-8db0-46ac-9ac4-c0465dab9836 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1316 microversion: 2.1 time: 0.317451 Oct 13 04:19:28.833309 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 155/310] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:28 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:28.841021 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-075babde-fcc8-4c49-93c8-84d9c4b4aa6a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:28.845224 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-075babde-fcc8-4c49-93c8-84d9c4b4aa6a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:28.861178 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7f400865-a836-4bf5-94d1-22acd242b183 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.286241 Oct 13 04:19:28.862604 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 156/311] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:28 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:28.864921 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-075babde-fcc8-4c49-93c8-84d9c4b4aa6a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:28.865927 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-075babde-fcc8-4c49-93c8-84d9c4b4aa6a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:28.866847 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-075babde-fcc8-4c49-93c8-84d9c4b4aa6a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:28.868502 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-075babde-fcc8-4c49-93c8-84d9c4b4aa6a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:28.979614 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-075babde-fcc8-4c49-93c8-84d9c4b4aa6a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.144938 Oct 13 04:19:28.980367 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 156/312] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:28 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:29.253270 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9ad2d27a-2b9a-42e3-9cc3-e55d7d937f10 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:29.254700 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9ad2d27a-2b9a-42e3-9cc3-e55d7d937f10 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:29.261992 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9ad2d27a-2b9a-42e3-9cc3-e55d7d937f10 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:29.262549 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9ad2d27a-2b9a-42e3-9cc3-e55d7d937f10 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:29.263515 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9ad2d27a-2b9a-42e3-9cc3-e55d7d937f10 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:29.264151 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9ad2d27a-2b9a-42e3-9cc3-e55d7d937f10 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:29.604445 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-9ad2d27a-2b9a-42e3-9cc3-e55d7d937f10 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:29.618186 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9ad2d27a-2b9a-42e3-9cc3-e55d7d937f10 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1314 microversion: 2.1 time: 0.369261 Oct 13 04:19:29.618734 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 157/313] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:29 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:29.847825 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-46555da8-21e7-4007-bb76-2e62450136f6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:29.849108 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-46555da8-21e7-4007-bb76-2e62450136f6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:29.855980 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-46555da8-21e7-4007-bb76-2e62450136f6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:29.856603 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-46555da8-21e7-4007-bb76-2e62450136f6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:29.857364 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-46555da8-21e7-4007-bb76-2e62450136f6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:29.857970 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-46555da8-21e7-4007-bb76-2e62450136f6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:29.876503 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-bda597e1-0c4a-49d0-b6cc-cb0003bef6f4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:29.877714 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-bda597e1-0c4a-49d0-b6cc-cb0003bef6f4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:29.887641 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bda597e1-0c4a-49d0-b6cc-cb0003bef6f4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:29.888411 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bda597e1-0c4a-49d0-b6cc-cb0003bef6f4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:29.889402 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bda597e1-0c4a-49d0-b6cc-cb0003bef6f4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:29.890168 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bda597e1-0c4a-49d0-b6cc-cb0003bef6f4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:29.991325 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-bda597e1-0c4a-49d0-b6cc-cb0003bef6f4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.118559 Oct 13 04:19:29.992702 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 158/314] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:29 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:29.999934 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-704715de-b426-40be-a3c4-9b6dabdf758d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:30.002849 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-704715de-b426-40be-a3c4-9b6dabdf758d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:30.018594 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-704715de-b426-40be-a3c4-9b6dabdf758d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:30.019038 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-704715de-b426-40be-a3c4-9b6dabdf758d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:30.019886 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-704715de-b426-40be-a3c4-9b6dabdf758d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:30.020316 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-704715de-b426-40be-a3c4-9b6dabdf758d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:30.071889 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-46555da8-21e7-4007-bb76-2e62450136f6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:30.079714 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-46555da8-21e7-4007-bb76-2e62450136f6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1316 microversion: 2.1 time: 0.235852 Oct 13 04:19:30.080282 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 157/315] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:29 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:30.178183 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-704715de-b426-40be-a3c4-9b6dabdf758d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.183448 Oct 13 04:19:30.186247 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 159/316] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:29 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:30.197109 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-c5eb7710-6118-40f0-8d15-28d328e41b26 req-7943605e-850f-4e99-8a4a-20c005c155f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8147fc29-c466-4164-b49c-0f8c733a11f7", "tag": "e954c7e7-2db7-4d12-91cb-5ee2d4db563c"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:30.200841 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:19:30.200841 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:19:30.211062 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-c5eb7710-6118-40f0-8d15-28d328e41b26 req-7943605e-850f-4e99-8a4a-20c005c155f7 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:30.211841 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-c5eb7710-6118-40f0-8d15-28d328e41b26 req-7943605e-850f-4e99-8a4a-20c005c155f7 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:30.225488 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-c5eb7710-6118-40f0-8d15-28d328e41b26 req-7943605e-850f-4e99-8a4a-20c005c155f7 service nova] Creating event network-changed:e954c7e7-2db7-4d12-91cb-5ee2d4db563c for instance 8147fc29-c466-4164-b49c-0f8c733a11f7 on hv-cinder-81275 Oct 13 04:19:30.230981 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-c5eb7710-6118-40f0-8d15-28d328e41b26 req-7943605e-850f-4e99-8a4a-20c005c155f7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041633 Oct 13 04:19:30.232162 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 158/317] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:19:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:30.635805 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-31227fd9-a1c1-412e-a446-d255824b7fc8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:30.636579 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-31227fd9-a1c1-412e-a446-d255824b7fc8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:30.643143 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-31227fd9-a1c1-412e-a446-d255824b7fc8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:30.643610 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-31227fd9-a1c1-412e-a446-d255824b7fc8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:30.644371 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-31227fd9-a1c1-412e-a446-d255824b7fc8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:30.644827 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-31227fd9-a1c1-412e-a446-d255824b7fc8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:30.854015 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-31227fd9-a1c1-412e-a446-d255824b7fc8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:30.865124 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-31227fd9-a1c1-412e-a446-d255824b7fc8 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1314 microversion: 2.1 time: 0.232723 Oct 13 04:19:30.876181 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 160/318] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:30 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:31.005174 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-00713f70-9dbf-4748-960f-2f457231f128 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:31.006269 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-00713f70-9dbf-4748-960f-2f457231f128 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:31.017143 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-00713f70-9dbf-4748-960f-2f457231f128 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:31.017630 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-00713f70-9dbf-4748-960f-2f457231f128 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:31.018560 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-00713f70-9dbf-4748-960f-2f457231f128 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:31.019000 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-00713f70-9dbf-4748-960f-2f457231f128 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:31.097384 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-36068e41-a5d0-4b02-9601-6fae52b15aa8 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:31.098384 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-36068e41-a5d0-4b02-9601-6fae52b15aa8 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:31.122613 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-36068e41-a5d0-4b02-9601-6fae52b15aa8 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:31.123074 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-36068e41-a5d0-4b02-9601-6fae52b15aa8 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:31.126936 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-36068e41-a5d0-4b02-9601-6fae52b15aa8 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:31.130046 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-36068e41-a5d0-4b02-9601-6fae52b15aa8 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:31.368115 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-36068e41-a5d0-4b02-9601-6fae52b15aa8 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:31.375644 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-36068e41-a5d0-4b02-9601-6fae52b15aa8 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1316 microversion: 2.1 time: 0.282999 Oct 13 04:19:31.376555 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 161/319] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:31 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:31.381203 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-965e02ca-50a2-4ee2-ac04-157d9bf33600 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:31.381355 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-00713f70-9dbf-4748-960f-2f457231f128 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.380549 Oct 13 04:19:31.382507 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 159/320] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:30 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:31.386585 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-965e02ca-50a2-4ee2-ac04-157d9bf33600 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:31.395683 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-965e02ca-50a2-4ee2-ac04-157d9bf33600 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:31.396443 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-965e02ca-50a2-4ee2-ac04-157d9bf33600 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:31.397891 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-965e02ca-50a2-4ee2-ac04-157d9bf33600 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:31.399896 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-965e02ca-50a2-4ee2-ac04-157d9bf33600 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:31.504118 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-965e02ca-50a2-4ee2-ac04-157d9bf33600 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.126117 Oct 13 04:19:31.505361 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 162/321] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:31 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:31.883464 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1166d52b-8cce-467a-a368-f72409caee7b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:31.884305 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1166d52b-8cce-467a-a368-f72409caee7b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:31.891452 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1166d52b-8cce-467a-a368-f72409caee7b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:31.892214 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1166d52b-8cce-467a-a368-f72409caee7b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:31.893202 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1166d52b-8cce-467a-a368-f72409caee7b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:31.893997 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1166d52b-8cce-467a-a368-f72409caee7b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:32.030853 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1166d52b-8cce-467a-a368-f72409caee7b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:32.044543 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1166d52b-8cce-467a-a368-f72409caee7b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1314 microversion: 2.1 time: 0.165283 Oct 13 04:19:32.045279 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 160/322] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:31 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:32.393033 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-dc16691c-2ecf-4ea7-8ad1-da23554b45db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:32.393539 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-49680b50-955c-4b0c-a963-7f45fa74d298 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:32.394635 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-dc16691c-2ecf-4ea7-8ad1-da23554b45db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:32.394757 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-49680b50-955c-4b0c-a963-7f45fa74d298 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:32.401662 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49680b50-955c-4b0c-a963-7f45fa74d298 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:32.401849 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dc16691c-2ecf-4ea7-8ad1-da23554b45db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:32.402255 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49680b50-955c-4b0c-a963-7f45fa74d298 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:32.402376 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dc16691c-2ecf-4ea7-8ad1-da23554b45db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:32.403025 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dc16691c-2ecf-4ea7-8ad1-da23554b45db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:32.403162 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49680b50-955c-4b0c-a963-7f45fa74d298 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:32.403472 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49680b50-955c-4b0c-a963-7f45fa74d298 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:32.404485 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dc16691c-2ecf-4ea7-8ad1-da23554b45db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:32.491854 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-49680b50-955c-4b0c-a963-7f45fa74d298 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28167 microversion: 2.1 time: 0.096398 Oct 13 04:19:32.491854 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 163/323] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:32 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28167 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:32.517886 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-19d9d502-2422-4b71-8958-e64e76352203 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:32.519186 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-19d9d502-2422-4b71-8958-e64e76352203 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:32.528568 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-19d9d502-2422-4b71-8958-e64e76352203 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:32.529996 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-19d9d502-2422-4b71-8958-e64e76352203 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:32.533397 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-19d9d502-2422-4b71-8958-e64e76352203 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:32.533868 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-19d9d502-2422-4b71-8958-e64e76352203 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:32.578738 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-dc16691c-2ecf-4ea7-8ad1-da23554b45db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:32.586205 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-dc16691c-2ecf-4ea7-8ad1-da23554b45db tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1316 microversion: 2.1 time: 0.197175 Oct 13 04:19:32.586778 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 161/324] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:32 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:32.710242 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-19d9d502-2422-4b71-8958-e64e76352203 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.197313 Oct 13 04:19:32.713659 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 164/325] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:32 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:19:32.765282 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ffd1c1f9-16a8-4999-ab8c-e521ca7859bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-613897110", "imageRef": "4f468f34-171a-4b6e-a0cd-2e4c6fcda23d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad1401a3-1315-4343-905f-76fd363a95dd"}]}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:32.817375 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.network.neutron [None req-ffd1c1f9-16a8-4999-ab8c-e521ca7859bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] validate_networks() for [('ad1401a3-1315-4343-905f-76fd363a95dd', None, None, None, None, None)] {{(pid=108259) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:19:33.062153 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-86c1f7d2-10ad-4fd8-af14-57b38c47240d tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:33.063182 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-86c1f7d2-10ad-4fd8-af14-57b38c47240d tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:33.069972 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-86c1f7d2-10ad-4fd8-af14-57b38c47240d tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:33.070755 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-86c1f7d2-10ad-4fd8-af14-57b38c47240d tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:33.071881 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-86c1f7d2-10ad-4fd8-af14-57b38c47240d tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:33.072499 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-86c1f7d2-10ad-4fd8-af14-57b38c47240d tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:33.242794 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-ffd1c1f9-16a8-4999-ab8c-e521ca7859bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Flavor limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:19:33.243457 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-ffd1c1f9-16a8-4999-ab8c-e521ca7859bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Image limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:19:33.244388 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-ffd1c1f9-16a8-4999-ab8c-e521ca7859bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Flavor pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:19:33.244852 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-ffd1c1f9-16a8-4999-ab8c-e521ca7859bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Image pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:19:33.246061 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-ffd1c1f9-16a8-4999-ab8c-e521ca7859bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:19:33.257292 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ffd1c1f9-16a8-4999-ab8c-e521ca7859bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:33.258005 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ffd1c1f9-16a8-4999-ab8c-e521ca7859bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:33.259443 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ffd1c1f9-16a8-4999-ab8c-e521ca7859bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:33.260030 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ffd1c1f9-16a8-4999-ab8c-e521ca7859bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:33.268307 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-86c1f7d2-10ad-4fd8-af14-57b38c47240d tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:33.281088 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-86c1f7d2-10ad-4fd8-af14-57b38c47240d tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1314 microversion: 2.1 time: 0.220524 Oct 13 04:19:33.281658 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-ffd1c1f9-16a8-4999-ab8c-e521ca7859bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Getting quotas for project 6d40f7ce511c4c95acdbf891d32505c6. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:19:33.281935 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 165/326] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:33 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:19:33.297741 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-ffd1c1f9-16a8-4999-ab8c-e521ca7859bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Getting quotas for user e98410f486ef48e396526c6528d7d1ea and project 6d40f7ce511c4c95acdbf891d32505c6. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:19:33.315313 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ffd1c1f9-16a8-4999-ab8c-e521ca7859bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Going to run 1 instances... {{(pid=108259) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:19:33.317998 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ffd1c1f9-16a8-4999-ab8c-e521ca7859bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f468f34-171a-4b6e-a0cd-2e4c6fcda23d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:19:33.372421 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ffd1c1f9-16a8-4999-ab8c-e521ca7859bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.726495 Oct 13 04:19:33.373058 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 162/327] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Oct 13 04:19:32 2021] POST /compute/v2.1/servers => generated 383 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 04:19:33.383502 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c727ad70-9e83-4781-9859-7d6337268650 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:33.384515 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c727ad70-9e83-4781-9859-7d6337268650 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:33.436710 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-c727ad70-9e83-4781-9859-7d6337268650 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:33.443581 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c727ad70-9e83-4781-9859-7d6337268650 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1221 microversion: 2.1 time: 0.064345 Oct 13 04:19:33.444150 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 166/328] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:33 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1221 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:19:33.499320 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-62f3d4ff-7cf2-41fa-983c-68f6e8004429 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-392960189", "imageRef": "4f468f34-171a-4b6e-a0cd-2e4c6fcda23d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad1401a3-1315-4343-905f-76fd363a95dd"}]}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:33.500356 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-98b1b2e2-3d1b-431e-b13a-80244706468f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:33.501414 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-98b1b2e2-3d1b-431e-b13a-80244706468f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:33.512395 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-98b1b2e2-3d1b-431e-b13a-80244706468f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:33.512836 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-98b1b2e2-3d1b-431e-b13a-80244706468f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:33.513647 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-98b1b2e2-3d1b-431e-b13a-80244706468f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:33.514325 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-98b1b2e2-3d1b-431e-b13a-80244706468f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:33.561287 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.network.neutron [None req-62f3d4ff-7cf2-41fa-983c-68f6e8004429 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] validate_networks() for [('ad1401a3-1315-4343-905f-76fd363a95dd', None, None, None, None, None)] {{(pid=108259) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:19:33.816780 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-98b1b2e2-3d1b-431e-b13a-80244706468f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28458 microversion: 2.1 time: 0.319960 Oct 13 04:19:33.818975 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 167/329] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:33 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28458 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:33.824412 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-205a9fc3-da73-4e40-9145-3980acd73d47 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:33.825521 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-205a9fc3-da73-4e40-9145-3980acd73d47 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:33.833533 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-205a9fc3-da73-4e40-9145-3980acd73d47 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:33.834261 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-205a9fc3-da73-4e40-9145-3980acd73d47 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:33.835102 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-205a9fc3-da73-4e40-9145-3980acd73d47 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:33.835597 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-205a9fc3-da73-4e40-9145-3980acd73d47 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:34.020503 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-62f3d4ff-7cf2-41fa-983c-68f6e8004429 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Flavor limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:19:34.021266 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-62f3d4ff-7cf2-41fa-983c-68f6e8004429 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Image limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:19:34.021922 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-62f3d4ff-7cf2-41fa-983c-68f6e8004429 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Flavor pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:19:34.022621 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-62f3d4ff-7cf2-41fa-983c-68f6e8004429 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Image pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:19:34.023225 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-62f3d4ff-7cf2-41fa-983c-68f6e8004429 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:19:34.035739 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62f3d4ff-7cf2-41fa-983c-68f6e8004429 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:34.036226 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62f3d4ff-7cf2-41fa-983c-68f6e8004429 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:34.037123 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62f3d4ff-7cf2-41fa-983c-68f6e8004429 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:34.037645 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62f3d4ff-7cf2-41fa-983c-68f6e8004429 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:34.038695 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-205a9fc3-da73-4e40-9145-3980acd73d47 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:34.048714 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-205a9fc3-da73-4e40-9145-3980acd73d47 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1316 microversion: 2.1 time: 0.228245 Oct 13 04:19:34.049469 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 168/330] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:33 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:34.055487 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9df99468-9951-4489-8a4f-7684efc3d782 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:34.057077 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9df99468-9951-4489-8a4f-7684efc3d782 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:34.057238 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-62f3d4ff-7cf2-41fa-983c-68f6e8004429 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Getting quotas for project 6d40f7ce511c4c95acdbf891d32505c6. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:19:34.061983 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-62f3d4ff-7cf2-41fa-983c-68f6e8004429 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Getting quotas for user e98410f486ef48e396526c6528d7d1ea and project 6d40f7ce511c4c95acdbf891d32505c6. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:19:34.064338 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9df99468-9951-4489-8a4f-7684efc3d782 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:34.064932 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9df99468-9951-4489-8a4f-7684efc3d782 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:34.065920 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9df99468-9951-4489-8a4f-7684efc3d782 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:34.066521 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9df99468-9951-4489-8a4f-7684efc3d782 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:34.074565 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-62f3d4ff-7cf2-41fa-983c-68f6e8004429 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Going to run 1 instances... {{(pid=108259) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:19:34.076807 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-62f3d4ff-7cf2-41fa-983c-68f6e8004429 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f468f34-171a-4b6e-a0cd-2e4c6fcda23d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:19:34.129280 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-62f3d4ff-7cf2-41fa-983c-68f6e8004429 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.635231 Oct 13 04:19:34.130638 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 163/331] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Oct 13 04:19:33 2021] POST /compute/v2.1/servers => generated 383 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 04:19:34.141009 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c5c88285-75f3-419e-acf4-d561a324571c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:34.141857 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c5c88285-75f3-419e-acf4-d561a324571c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:34.149306 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9df99468-9951-4489-8a4f-7684efc3d782 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28158 microversion: 2.20 time: 0.098142 Oct 13 04:19:34.150341 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 169/332] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:34 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28158 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:34.207731 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c5c88285-75f3-419e-acf4-d561a324571c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:34.215385 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c5c88285-75f3-419e-acf4-d561a324571c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1221 microversion: 2.1 time: 0.078826 Oct 13 04:19:34.216138 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 164/333] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:34 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1221 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:34.298365 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e233d1e1-86eb-4346-a8b8-142095fba0e3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:34.299049 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e233d1e1-86eb-4346-a8b8-142095fba0e3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:34.305775 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e233d1e1-86eb-4346-a8b8-142095fba0e3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:34.306217 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e233d1e1-86eb-4346-a8b8-142095fba0e3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:34.306985 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e233d1e1-86eb-4346-a8b8-142095fba0e3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:34.307410 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e233d1e1-86eb-4346-a8b8-142095fba0e3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:34.443071 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-e233d1e1-86eb-4346-a8b8-142095fba0e3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:34.452651 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e233d1e1-86eb-4346-a8b8-142095fba0e3 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1314 microversion: 2.1 time: 0.158079 Oct 13 04:19:34.454051 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 170/334] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:34 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:19:34.828683 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4d54bb24-fc9d-47d3-8992-786f395183ec tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:34.829818 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4d54bb24-fc9d-47d3-8992-786f395183ec tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:34.835667 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4d54bb24-fc9d-47d3-8992-786f395183ec tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:34.836110 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4d54bb24-fc9d-47d3-8992-786f395183ec tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:34.836881 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4d54bb24-fc9d-47d3-8992-786f395183ec tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:34.837435 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4d54bb24-fc9d-47d3-8992-786f395183ec tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:34.926685 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4d54bb24-fc9d-47d3-8992-786f395183ec tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28458 microversion: 2.1 time: 0.101838 Oct 13 04:19:34.927340 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 165/335] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:34 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28458 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:35.065928 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6972a2ae-94da-40a5-96d8-9a87ef59af0f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:35.066537 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6972a2ae-94da-40a5-96d8-9a87ef59af0f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:35.073301 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6972a2ae-94da-40a5-96d8-9a87ef59af0f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:35.073858 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6972a2ae-94da-40a5-96d8-9a87ef59af0f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:35.074667 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6972a2ae-94da-40a5-96d8-9a87ef59af0f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:35.075789 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6972a2ae-94da-40a5-96d8-9a87ef59af0f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:35.162704 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-108c5722-4790-4879-8698-b3120441dd73 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:35.164056 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-108c5722-4790-4879-8698-b3120441dd73 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:35.171635 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-108c5722-4790-4879-8698-b3120441dd73 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:35.172461 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-108c5722-4790-4879-8698-b3120441dd73 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:35.173707 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-108c5722-4790-4879-8698-b3120441dd73 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:35.174298 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-108c5722-4790-4879-8698-b3120441dd73 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:35.322180 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6972a2ae-94da-40a5-96d8-9a87ef59af0f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:35.330386 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6972a2ae-94da-40a5-96d8-9a87ef59af0f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1316 microversion: 2.1 time: 0.268152 Oct 13 04:19:35.331130 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 171/336] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:35 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:35.335811 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6e3b1a39-d430-4fdf-a2dc-ba47da6adccf tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:35.336600 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6e3b1a39-d430-4fdf-a2dc-ba47da6adccf tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:35.342293 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6e3b1a39-d430-4fdf-a2dc-ba47da6adccf tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:35.342892 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6e3b1a39-d430-4fdf-a2dc-ba47da6adccf tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:35.343476 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6e3b1a39-d430-4fdf-a2dc-ba47da6adccf tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:35.343895 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6e3b1a39-d430-4fdf-a2dc-ba47da6adccf tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:35.409360 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-108c5722-4790-4879-8698-b3120441dd73 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28367 microversion: 2.20 time: 0.251225 Oct 13 04:19:35.414009 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 166/337] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:35 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:19:35.437282 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6e3b1a39-d430-4fdf-a2dc-ba47da6adccf tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:35.447079 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6e3b1a39-d430-4fdf-a2dc-ba47da6adccf tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1273 microversion: 2.1 time: 0.114729 Oct 13 04:19:35.451320 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 172/338] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:35 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:35.476374 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-87ee0fe9-a04a-4669-8776-ea681b223285 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:35.477057 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-87ee0fe9-a04a-4669-8776-ea681b223285 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:35.483899 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-87ee0fe9-a04a-4669-8776-ea681b223285 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:35.484278 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-87ee0fe9-a04a-4669-8776-ea681b223285 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:35.485024 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-87ee0fe9-a04a-4669-8776-ea681b223285 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:35.485385 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-87ee0fe9-a04a-4669-8776-ea681b223285 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:35.786650 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-87ee0fe9-a04a-4669-8776-ea681b223285 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:35.796773 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-87ee0fe9-a04a-4669-8776-ea681b223285 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1314 microversion: 2.1 time: 0.324066 Oct 13 04:19:35.797680 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 167/339] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:35 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:35.938964 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-91e4b784-b8b4-4e9a-be97-92d62d2b891b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:35.940124 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-91e4b784-b8b4-4e9a-be97-92d62d2b891b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:35.946103 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-91e4b784-b8b4-4e9a-be97-92d62d2b891b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:35.946781 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-91e4b784-b8b4-4e9a-be97-92d62d2b891b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:35.947726 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-91e4b784-b8b4-4e9a-be97-92d62d2b891b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:35.948145 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-91e4b784-b8b4-4e9a-be97-92d62d2b891b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:36.046015 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-91e4b784-b8b4-4e9a-be97-92d62d2b891b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28458 microversion: 2.1 time: 0.110634 Oct 13 04:19:36.050896 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 173/340] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:35 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28458 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:19:36.260898 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-76148190-b475-4d36-8b47-4c9f0d85df55 req-d0f926d4-3ad5-48ee-89fb-3ca014e661c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58316e9-818c-4986-9148-932d51f34cc9", "name": "network-vif-plugged", "status": "completed", "tag": "355dc108-256f-4efe-8035-feb0a826461d"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:36.262903 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:19:36.262903 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:19:36.272350 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-76148190-b475-4d36-8b47-4c9f0d85df55 req-d0f926d4-3ad5-48ee-89fb-3ca014e661c7 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:36.273110 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-76148190-b475-4d36-8b47-4c9f0d85df55 req-d0f926d4-3ad5-48ee-89fb-3ca014e661c7 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:36.286494 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-76148190-b475-4d36-8b47-4c9f0d85df55 req-d0f926d4-3ad5-48ee-89fb-3ca014e661c7 service nova] Creating event network-vif-plugged:355dc108-256f-4efe-8035-feb0a826461d for instance d58316e9-818c-4986-9148-932d51f34cc9 on hv-cinder-81275 Oct 13 04:19:36.293124 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-76148190-b475-4d36-8b47-4c9f0d85df55 req-d0f926d4-3ad5-48ee-89fb-3ca014e661c7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041807 Oct 13 04:19:36.294021 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 168/341] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:19:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:36.348701 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-92c9e1e1-4b80-4c91-a17f-50c22f04345c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:36.349495 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-92c9e1e1-4b80-4c91-a17f-50c22f04345c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:36.356915 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-92c9e1e1-4b80-4c91-a17f-50c22f04345c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:36.357717 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-92c9e1e1-4b80-4c91-a17f-50c22f04345c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:36.358705 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-92c9e1e1-4b80-4c91-a17f-50c22f04345c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:36.359341 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-92c9e1e1-4b80-4c91-a17f-50c22f04345c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:36.429761 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e704d51a-cb86-4ad2-bafd-e913ee72b585 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:36.431143 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e704d51a-cb86-4ad2-bafd-e913ee72b585 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:36.440668 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e704d51a-cb86-4ad2-bafd-e913ee72b585 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:36.441389 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e704d51a-cb86-4ad2-bafd-e913ee72b585 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:36.442639 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e704d51a-cb86-4ad2-bafd-e913ee72b585 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:36.443842 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e704d51a-cb86-4ad2-bafd-e913ee72b585 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:36.653813 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e704d51a-cb86-4ad2-bafd-e913ee72b585 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28448 microversion: 2.20 time: 0.227507 Oct 13 04:19:36.653813 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 169/342] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:36 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28448 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:19:36.653813 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2477ffe1-62a3-4e2d-80bb-27a5c975efdc tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:36.653813 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2477ffe1-62a3-4e2d-80bb-27a5c975efdc tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:36.660936 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2477ffe1-62a3-4e2d-80bb-27a5c975efdc tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:36.661251 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2477ffe1-62a3-4e2d-80bb-27a5c975efdc tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:36.664689 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2477ffe1-62a3-4e2d-80bb-27a5c975efdc tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:36.665136 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2477ffe1-62a3-4e2d-80bb-27a5c975efdc tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:36.806027 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2477ffe1-62a3-4e2d-80bb-27a5c975efdc tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:36.816718 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2477ffe1-62a3-4e2d-80bb-27a5c975efdc tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1279 microversion: 2.1 time: 0.168718 Oct 13 04:19:36.827074 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 170/343] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:36 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1279 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:36.837092 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-6b871f90-a4a6-4e7e-a40e-8042f50c9c15 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:36.837744 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-6b871f90-a4a6-4e7e-a40e-8042f50c9c15 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:36.844209 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6b871f90-a4a6-4e7e-a40e-8042f50c9c15 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:36.844655 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6b871f90-a4a6-4e7e-a40e-8042f50c9c15 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:36.845487 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6b871f90-a4a6-4e7e-a40e-8042f50c9c15 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:36.846102 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6b871f90-a4a6-4e7e-a40e-8042f50c9c15 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:36.995481 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-92c9e1e1-4b80-4c91-a17f-50c22f04345c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:37.004015 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-92c9e1e1-4b80-4c91-a17f-50c22f04345c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1316 microversion: 2.1 time: 0.659412 Oct 13 04:19:37.005455 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 174/344] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:36 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1316 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:37.010412 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-1696ff13-54ad-450a-9bb0-89b194c35aec req-59aad634-0469-4474-8b03-c33c92a53a3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b4223c8-bfe1-440e-89bc-7158a1490e1c", "tag": "a005bba9-2263-44ad-abba-36d29b7c7e7c"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:37.012391 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:19:37.012391 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:19:37.022086 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-1696ff13-54ad-450a-9bb0-89b194c35aec req-59aad634-0469-4474-8b03-c33c92a53a3f service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:37.023100 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-1696ff13-54ad-450a-9bb0-89b194c35aec req-59aad634-0469-4474-8b03-c33c92a53a3f service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:37.038610 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-1696ff13-54ad-450a-9bb0-89b194c35aec req-59aad634-0469-4474-8b03-c33c92a53a3f service nova] Creating event network-changed:a005bba9-2263-44ad-abba-36d29b7c7e7c for instance 2b4223c8-bfe1-440e-89bc-7158a1490e1c on hv-cinder-81275 Oct 13 04:19:37.044640 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-1696ff13-54ad-450a-9bb0-89b194c35aec req-59aad634-0469-4474-8b03-c33c92a53a3f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036949 Oct 13 04:19:37.045763 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 175/345] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:19:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:37.060246 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6d83d0ac-4ef8-4122-b8c9-de8bef85a974 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:37.061489 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6d83d0ac-4ef8-4122-b8c9-de8bef85a974 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:37.067885 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6d83d0ac-4ef8-4122-b8c9-de8bef85a974 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:37.068329 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6d83d0ac-4ef8-4122-b8c9-de8bef85a974 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:37.069136 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6d83d0ac-4ef8-4122-b8c9-de8bef85a974 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:37.069945 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6d83d0ac-4ef8-4122-b8c9-de8bef85a974 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:37.140046 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-6b871f90-a4a6-4e7e-a40e-8042f50c9c15 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:37.148650 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-6b871f90-a4a6-4e7e-a40e-8042f50c9c15 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1314 microversion: 2.1 time: 0.320255 Oct 13 04:19:37.149350 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 171/346] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:36 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:37.437643 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6d83d0ac-4ef8-4122-b8c9-de8bef85a974 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.381972 Oct 13 04:19:37.438585 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 176/347] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:37 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:37.657448 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-40ea53ae-4c65-49f2-897b-b906f36892a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:37.658317 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-40ea53ae-4c65-49f2-897b-b906f36892a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:37.665192 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-40ea53ae-4c65-49f2-897b-b906f36892a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:37.665678 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-40ea53ae-4c65-49f2-897b-b906f36892a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:37.666434 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-40ea53ae-4c65-49f2-897b-b906f36892a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:37.666860 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-40ea53ae-4c65-49f2-897b-b906f36892a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:37.733300 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-40ea53ae-4c65-49f2-897b-b906f36892a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28448 microversion: 2.20 time: 0.079596 Oct 13 04:19:37.737288 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 172/348] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:37 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28448 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:37.834820 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-85a0628c-023c-4f4a-90db-37fcf0516d83 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:37.835509 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-85a0628c-023c-4f4a-90db-37fcf0516d83 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:37.842761 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-85a0628c-023c-4f4a-90db-37fcf0516d83 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:37.843299 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-85a0628c-023c-4f4a-90db-37fcf0516d83 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:37.844245 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-85a0628c-023c-4f4a-90db-37fcf0516d83 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:37.844756 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-85a0628c-023c-4f4a-90db-37fcf0516d83 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:38.023230 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d4c90695-991a-4005-bf2a-3d2c2c782ccd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:38.024454 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d4c90695-991a-4005-bf2a-3d2c2c782ccd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:38.031329 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d4c90695-991a-4005-bf2a-3d2c2c782ccd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:38.031775 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d4c90695-991a-4005-bf2a-3d2c2c782ccd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:38.032554 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d4c90695-991a-4005-bf2a-3d2c2c782ccd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:38.032983 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d4c90695-991a-4005-bf2a-3d2c2c782ccd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:38.291353 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-85a0628c-023c-4f4a-90db-37fcf0516d83 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:38.301476 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-85a0628c-023c-4f4a-90db-37fcf0516d83 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1321 microversion: 2.1 time: 0.470670 Oct 13 04:19:38.303320 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 177/349] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:37 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1321 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:38.309439 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f1a574fb-7f94-44fa-b2b1-731af1bfcdc6 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:38.310261 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f1a574fb-7f94-44fa-b2b1-731af1bfcdc6 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:38.317294 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f1a574fb-7f94-44fa-b2b1-731af1bfcdc6 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:38.318313 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f1a574fb-7f94-44fa-b2b1-731af1bfcdc6 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:38.319382 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f1a574fb-7f94-44fa-b2b1-731af1bfcdc6 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:38.321150 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f1a574fb-7f94-44fa-b2b1-731af1bfcdc6 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:38.739332 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-d4c90695-991a-4005-bf2a-3d2c2c782ccd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:38.746905 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d4c90695-991a-4005-bf2a-3d2c2c782ccd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1316 microversion: 2.1 time: 0.728341 Oct 13 04:19:38.747823 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 173/350] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:38 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1316 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:38.761100 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-322ddb08-07bc-4f40-a2f7-351e93f3f0c3 req-2bdfda81-b4a9-4651-bc27-c92263bc8348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8147fc29-c466-4164-b49c-0f8c733a11f7", "name": "network-vif-plugged", "status": "completed", "tag": "e954c7e7-2db7-4d12-91cb-5ee2d4db563c"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:38.763056 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:19:38.763056 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:19:38.771013 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-322ddb08-07bc-4f40-a2f7-351e93f3f0c3 req-2bdfda81-b4a9-4651-bc27-c92263bc8348 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:38.772639 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-322ddb08-07bc-4f40-a2f7-351e93f3f0c3 req-2bdfda81-b4a9-4651-bc27-c92263bc8348 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:38.782920 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-322ddb08-07bc-4f40-a2f7-351e93f3f0c3 req-2bdfda81-b4a9-4651-bc27-c92263bc8348 service nova] Creating event network-vif-plugged:e954c7e7-2db7-4d12-91cb-5ee2d4db563c for instance 8147fc29-c466-4164-b49c-0f8c733a11f7 on hv-cinder-81275 Oct 13 04:19:38.789809 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-322ddb08-07bc-4f40-a2f7-351e93f3f0c3 req-2bdfda81-b4a9-4651-bc27-c92263bc8348 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032047 Oct 13 04:19:38.790921 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 174/351] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:19:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:38.797456 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-91b45554-3845-4181-8669-118cff5f2531 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:38.798941 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-91b45554-3845-4181-8669-118cff5f2531 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:38.806442 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-91b45554-3845-4181-8669-118cff5f2531 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:38.807152 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-91b45554-3845-4181-8669-118cff5f2531 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:38.808123 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-91b45554-3845-4181-8669-118cff5f2531 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:38.808702 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-91b45554-3845-4181-8669-118cff5f2531 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:38.928324 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-91b45554-3845-4181-8669-118cff5f2531 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.135367 Oct 13 04:19:38.928989 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 175/352] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:38 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:38.934804 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-19d087b6-dd1b-49a8-a588-1129be608d86 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:38.935934 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-19d087b6-dd1b-49a8-a588-1129be608d86 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:38.955413 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-19d087b6-dd1b-49a8-a588-1129be608d86 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:38.956805 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-19d087b6-dd1b-49a8-a588-1129be608d86 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:38.958218 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-19d087b6-dd1b-49a8-a588-1129be608d86 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:38.958735 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-19d087b6-dd1b-49a8-a588-1129be608d86 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:38.996609 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f1a574fb-7f94-44fa-b2b1-731af1bfcdc6 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:39.003795 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f1a574fb-7f94-44fa-b2b1-731af1bfcdc6 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1314 microversion: 2.1 time: 0.698962 Oct 13 04:19:39.004353 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 178/353] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:38 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1314 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:39.232182 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-cc17f736-d594-4ef6-b7f7-bcea15ff9315 req-dd9197b8-8a52-4ff3-bb19-af0cdd9db561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb288c24-304a-4fc1-bcbc-42dbfdec3fe1", "tag": "d06e81cd-60bd-4e5e-b109-0c41c2176eff"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:39.234193 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:19:39.234193 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:19:39.241293 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-cc17f736-d594-4ef6-b7f7-bcea15ff9315 req-dd9197b8-8a52-4ff3-bb19-af0cdd9db561 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:39.241756 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-cc17f736-d594-4ef6-b7f7-bcea15ff9315 req-dd9197b8-8a52-4ff3-bb19-af0cdd9db561 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:39.253567 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-cc17f736-d594-4ef6-b7f7-bcea15ff9315 req-dd9197b8-8a52-4ff3-bb19-af0cdd9db561 service nova] Creating event network-changed:d06e81cd-60bd-4e5e-b109-0c41c2176eff for instance cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 on hv-cinder-81275 Oct 13 04:19:39.263410 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-cc17f736-d594-4ef6-b7f7-bcea15ff9315 req-dd9197b8-8a52-4ff3-bb19-af0cdd9db561 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034745 Oct 13 04:19:39.263997 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 179/354] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:19:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:19:39.319654 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d954799a-a1cd-4ac3-8111-c808f0dfae84 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:39.320334 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d954799a-a1cd-4ac3-8111-c808f0dfae84 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:39.327018 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d954799a-a1cd-4ac3-8111-c808f0dfae84 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:39.327453 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d954799a-a1cd-4ac3-8111-c808f0dfae84 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:39.328233 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d954799a-a1cd-4ac3-8111-c808f0dfae84 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:39.328658 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d954799a-a1cd-4ac3-8111-c808f0dfae84 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:39.450677 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d954799a-a1cd-4ac3-8111-c808f0dfae84 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:39.457772 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d954799a-a1cd-4ac3-8111-c808f0dfae84 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1321 microversion: 2.1 time: 0.142169 Oct 13 04:19:39.458322 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 180/355] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:39 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1321 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:39.512925 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-19d087b6-dd1b-49a8-a588-1129be608d86 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.581825 Oct 13 04:19:39.514019 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 176/356] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:38 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:39.763762 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-0243bfdf-f73f-48d0-bd46-d8e565d7fbff tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:39.764592 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-0243bfdf-f73f-48d0-bd46-d8e565d7fbff tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:39.770558 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0243bfdf-f73f-48d0-bd46-d8e565d7fbff tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:39.771215 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0243bfdf-f73f-48d0-bd46-d8e565d7fbff tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:39.771973 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0243bfdf-f73f-48d0-bd46-d8e565d7fbff tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:39.772388 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0243bfdf-f73f-48d0-bd46-d8e565d7fbff tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:39.940976 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-6f8245cb-59de-4664-a025-c551f6b79fb1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:39.941998 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-6f8245cb-59de-4664-a025-c551f6b79fb1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:39.948849 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6f8245cb-59de-4664-a025-c551f6b79fb1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:39.949285 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6f8245cb-59de-4664-a025-c551f6b79fb1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:39.950072 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6f8245cb-59de-4664-a025-c551f6b79fb1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:39.950495 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6f8245cb-59de-4664-a025-c551f6b79fb1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:40.027941 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-6f8245cb-59de-4664-a025-c551f6b79fb1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.090772 Oct 13 04:19:40.028525 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 177/357] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:39 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:40.033467 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-dfa0400f-e548-4d98-ab2b-f06a6075f4fd tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:40.034363 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-dfa0400f-e548-4d98-ab2b-f06a6075f4fd tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:40.041464 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dfa0400f-e548-4d98-ab2b-f06a6075f4fd tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:40.042176 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dfa0400f-e548-4d98-ab2b-f06a6075f4fd tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:40.042934 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dfa0400f-e548-4d98-ab2b-f06a6075f4fd tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:40.043367 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dfa0400f-e548-4d98-ab2b-f06a6075f4fd tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:40.063114 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-0243bfdf-f73f-48d0-bd46-d8e565d7fbff tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:40.071062 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-0243bfdf-f73f-48d0-bd46-d8e565d7fbff tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1316 microversion: 2.1 time: 0.310955 Oct 13 04:19:40.079291 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 181/358] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:39 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:40.203243 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-dfa0400f-e548-4d98-ab2b-f06a6075f4fd tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:40.210860 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-dfa0400f-e548-4d98-ab2b-f06a6075f4fd tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1314 microversion: 2.1 time: 0.181108 Oct 13 04:19:40.211456 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 178/359] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:40 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:40.474489 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-25f4a6eb-72ac-4a86-a15c-53506db213f8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:40.475181 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-25f4a6eb-72ac-4a86-a15c-53506db213f8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:40.481330 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-25f4a6eb-72ac-4a86-a15c-53506db213f8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:40.481809 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-25f4a6eb-72ac-4a86-a15c-53506db213f8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:40.482548 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-25f4a6eb-72ac-4a86-a15c-53506db213f8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:40.482970 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-25f4a6eb-72ac-4a86-a15c-53506db213f8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:40.525721 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2ac2ddd0-c3c9-49b3-afb1-a71373ded13c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:40.527289 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2ac2ddd0-c3c9-49b3-afb1-a71373ded13c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:40.533530 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2ac2ddd0-c3c9-49b3-afb1-a71373ded13c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:40.533987 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2ac2ddd0-c3c9-49b3-afb1-a71373ded13c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:40.534875 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2ac2ddd0-c3c9-49b3-afb1-a71373ded13c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:40.535300 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2ac2ddd0-c3c9-49b3-afb1-a71373ded13c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:40.642752 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-25f4a6eb-72ac-4a86-a15c-53506db213f8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:40.650387 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-25f4a6eb-72ac-4a86-a15c-53506db213f8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1321 microversion: 2.1 time: 0.179601 Oct 13 04:19:40.650926 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 182/360] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:40 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:41.040424 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2c5e0b4c-f2de-46c1-a63d-e68f23cfd6e2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:41.041322 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-2c5e0b4c-f2de-46c1-a63d-e68f23cfd6e2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:41.047931 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2c5e0b4c-f2de-46c1-a63d-e68f23cfd6e2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:41.048367 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2c5e0b4c-f2de-46c1-a63d-e68f23cfd6e2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:41.049155 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2c5e0b4c-f2de-46c1-a63d-e68f23cfd6e2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:41.049575 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2c5e0b4c-f2de-46c1-a63d-e68f23cfd6e2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:41.317077 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2ac2ddd0-c3c9-49b3-afb1-a71373ded13c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.794361 Oct 13 04:19:41.317737 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 179/361] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:40 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:19:41.321643 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-2c5e0b4c-f2de-46c1-a63d-e68f23cfd6e2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.285157 Oct 13 04:19:41.322276 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 183/362] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:41 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:41.322964 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2ae9cfd2-e3d9-47dd-bcfc-afd76c6e9c2f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:41.323727 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2ae9cfd2-e3d9-47dd-bcfc-afd76c6e9c2f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:41.327125 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-bca52902-ea0c-4df3-8be3-d8402fd05c71 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:41.327829 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-bca52902-ea0c-4df3-8be3-d8402fd05c71 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:41.330631 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2ae9cfd2-e3d9-47dd-bcfc-afd76c6e9c2f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:41.331252 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2ae9cfd2-e3d9-47dd-bcfc-afd76c6e9c2f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:41.332018 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2ae9cfd2-e3d9-47dd-bcfc-afd76c6e9c2f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:41.332440 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2ae9cfd2-e3d9-47dd-bcfc-afd76c6e9c2f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:41.334686 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bca52902-ea0c-4df3-8be3-d8402fd05c71 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:41.335122 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bca52902-ea0c-4df3-8be3-d8402fd05c71 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:41.335876 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bca52902-ea0c-4df3-8be3-d8402fd05c71 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:41.336305 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bca52902-ea0c-4df3-8be3-d8402fd05c71 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:41.506280 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2ae9cfd2-e3d9-47dd-bcfc-afd76c6e9c2f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:41.510914 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-bca52902-ea0c-4df3-8be3-d8402fd05c71 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:41.514569 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2ae9cfd2-e3d9-47dd-bcfc-afd76c6e9c2f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1506 microversion: 2.1 time: 0.195670 Oct 13 04:19:41.515146 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 180/363] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:41 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:41.518902 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-bca52902-ea0c-4df3-8be3-d8402fd05c71 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1314 microversion: 2.1 time: 0.195393 Oct 13 04:19:41.519643 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 184/364] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:41 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:41.667112 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0a839cfe-d4e6-4d20-bb1e-cf8284dca6a3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:41.667807 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0a839cfe-d4e6-4d20-bb1e-cf8284dca6a3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:41.673599 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0a839cfe-d4e6-4d20-bb1e-cf8284dca6a3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:41.674081 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0a839cfe-d4e6-4d20-bb1e-cf8284dca6a3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:41.674844 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0a839cfe-d4e6-4d20-bb1e-cf8284dca6a3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:41.675274 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0a839cfe-d4e6-4d20-bb1e-cf8284dca6a3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:41.817965 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-0a839cfe-d4e6-4d20-bb1e-cf8284dca6a3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:41.825354 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0a839cfe-d4e6-4d20-bb1e-cf8284dca6a3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1321 microversion: 2.1 time: 0.161906 Oct 13 04:19:41.825979 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 181/365] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:41 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:42.333300 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-43c7eb27-c986-46bb-ba7a-f4c0f32e244f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:42.334904 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-43c7eb27-c986-46bb-ba7a-f4c0f32e244f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:42.337144 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0ded60df-c063-49e0-8bc6-61815c1a9118 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:42.339419 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0ded60df-c063-49e0-8bc6-61815c1a9118 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:42.343256 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-43c7eb27-c986-46bb-ba7a-f4c0f32e244f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:42.343692 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-43c7eb27-c986-46bb-ba7a-f4c0f32e244f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:42.344445 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-43c7eb27-c986-46bb-ba7a-f4c0f32e244f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:42.344862 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-43c7eb27-c986-46bb-ba7a-f4c0f32e244f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:42.346135 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0ded60df-c063-49e0-8bc6-61815c1a9118 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:42.346579 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0ded60df-c063-49e0-8bc6-61815c1a9118 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:42.347534 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0ded60df-c063-49e0-8bc6-61815c1a9118 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:42.347968 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0ded60df-c063-49e0-8bc6-61815c1a9118 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:42.547886 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-43c7eb27-c986-46bb-ba7a-f4c0f32e244f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.220697 Oct 13 04:19:42.548911 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 185/366] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:42 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:42.553833 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-13812443-0a21-46fc-bef6-374c1425126b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:42.554522 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-13812443-0a21-46fc-bef6-374c1425126b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:42.561307 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-13812443-0a21-46fc-bef6-374c1425126b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:42.561773 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-13812443-0a21-46fc-bef6-374c1425126b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:42.562535 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-13812443-0a21-46fc-bef6-374c1425126b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:42.562967 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-13812443-0a21-46fc-bef6-374c1425126b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:42.578016 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0ded60df-c063-49e0-8bc6-61815c1a9118 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.246788 Oct 13 04:19:42.578782 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 182/367] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:42 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:42.696783 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-13812443-0a21-46fc-bef6-374c1425126b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:42.705691 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-13812443-0a21-46fc-bef6-374c1425126b tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1497 microversion: 2.1 time: 0.155082 Oct 13 04:19:42.706690 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 186/368] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:42 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:42.843123 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7626549b-2b49-47f4-a452-405b08adeef7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:42.843808 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7626549b-2b49-47f4-a452-405b08adeef7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:42.850838 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7626549b-2b49-47f4-a452-405b08adeef7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:42.851272 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7626549b-2b49-47f4-a452-405b08adeef7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:42.852043 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7626549b-2b49-47f4-a452-405b08adeef7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:42.852472 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7626549b-2b49-47f4-a452-405b08adeef7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:42.981458 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-7626549b-2b49-47f4-a452-405b08adeef7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:42.989216 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7626549b-2b49-47f4-a452-405b08adeef7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1321 microversion: 2.1 time: 0.150157 Oct 13 04:19:42.989673 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 183/369] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:42 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:43.560901 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-53b01cda-1052-4cbf-b884-43c4c4e081fc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:43.561880 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-53b01cda-1052-4cbf-b884-43c4c4e081fc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:43.568714 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-53b01cda-1052-4cbf-b884-43c4c4e081fc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:43.569155 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-53b01cda-1052-4cbf-b884-43c4c4e081fc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:43.569952 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-53b01cda-1052-4cbf-b884-43c4c4e081fc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:43.570376 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-53b01cda-1052-4cbf-b884-43c4c4e081fc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:43.590047 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0eee005b-1c90-4e7c-8ef0-9ea4d9af3576 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:43.590948 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0eee005b-1c90-4e7c-8ef0-9ea4d9af3576 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:43.597037 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0eee005b-1c90-4e7c-8ef0-9ea4d9af3576 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:43.597476 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0eee005b-1c90-4e7c-8ef0-9ea4d9af3576 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:43.598247 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0eee005b-1c90-4e7c-8ef0-9ea4d9af3576 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:43.598694 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0eee005b-1c90-4e7c-8ef0-9ea4d9af3576 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:43.766195 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0eee005b-1c90-4e7c-8ef0-9ea4d9af3576 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.179207 Oct 13 04:19:43.767205 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 184/370] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:43 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:43.778735 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-53b01cda-1052-4cbf-b884-43c4c4e081fc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.221923 Oct 13 04:19:43.779394 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 187/371] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:43 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:43.877098 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-85e49436-204b-4416-bf5f-6e8a9f5c69e4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c92728c2-58a8-414d-879d-737fa04db23c"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:43.878255 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-85e49436-204b-4416-bf5f-6e8a9f5c69e4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:43.884992 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-85e49436-204b-4416-bf5f-6e8a9f5c69e4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:43.885433 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-85e49436-204b-4416-bf5f-6e8a9f5c69e4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:43.886303 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-85e49436-204b-4416-bf5f-6e8a9f5c69e4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:43.886726 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-85e49436-204b-4416-bf5f-6e8a9f5c69e4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:44.007305 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-08b1bf42-dd6b-4ec3-82e8-3ee0fd775375 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:44.007994 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-08b1bf42-dd6b-4ec3-82e8-3ee0fd775375 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:44.015235 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-08b1bf42-dd6b-4ec3-82e8-3ee0fd775375 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:44.015963 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-08b1bf42-dd6b-4ec3-82e8-3ee0fd775375 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:44.016725 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-08b1bf42-dd6b-4ec3-82e8-3ee0fd775375 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:44.017150 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-08b1bf42-dd6b-4ec3-82e8-3ee0fd775375 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:44.139775 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-08b1bf42-dd6b-4ec3-82e8-3ee0fd775375 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:44.147159 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-08b1bf42-dd6b-4ec3-82e8-3ee0fd775375 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1321 microversion: 2.1 time: 0.144340 Oct 13 04:19:44.147720 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 188/372] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:44 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:19:44.783802 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a6104abb-3970-40be-a26a-3005b46be446 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:44.784756 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a6104abb-3970-40be-a26a-3005b46be446 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:44.792919 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a6104abb-3970-40be-a26a-3005b46be446 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:44.793351 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a6104abb-3970-40be-a26a-3005b46be446 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:44.794138 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a6104abb-3970-40be-a26a-3005b46be446 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:44.794557 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a6104abb-3970-40be-a26a-3005b46be446 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:48.157354 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a6104abb-3970-40be-a26a-3005b46be446 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 3.379431 Oct 13 04:19:48.158008 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 189/373] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:44 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 3381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:48.163515 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-461a9a01-216f-4673-8f48-f83dad2eb835 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:48.164673 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-461a9a01-216f-4673-8f48-f83dad2eb835 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:48.171313 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-461a9a01-216f-4673-8f48-f83dad2eb835 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:48.171762 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-461a9a01-216f-4673-8f48-f83dad2eb835 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:48.172498 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-461a9a01-216f-4673-8f48-f83dad2eb835 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:48.172921 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-461a9a01-216f-4673-8f48-f83dad2eb835 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:48.240841 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-85e49436-204b-4416-bf5f-6e8a9f5c69e4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "POST /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.367742 Oct 13 04:19:48.241581 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 185/374] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Oct 13 04:19:43 2021] POST /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments => generated 194 bytes in 4369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:48.246657 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d1133d2b-efde-45e2-9a8d-45eed0cd701c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:48.247445 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d1133d2b-efde-45e2-9a8d-45eed0cd701c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:48.254380 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d1133d2b-efde-45e2-9a8d-45eed0cd701c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:48.254856 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d1133d2b-efde-45e2-9a8d-45eed0cd701c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:48.255672 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d1133d2b-efde-45e2-9a8d-45eed0cd701c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:48.256061 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d1133d2b-efde-45e2-9a8d-45eed0cd701c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:48.381418 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-d1133d2b-efde-45e2-9a8d-45eed0cd701c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:48.388816 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d1133d2b-efde-45e2-9a8d-45eed0cd701c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1321 microversion: 2.1 time: 0.145951 Oct 13 04:19:48.389355 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 186/375] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:48 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:48.710856 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-461a9a01-216f-4673-8f48-f83dad2eb835 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.551217 Oct 13 04:19:48.711482 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 190/376] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:48 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:48.860144 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-bfa81582-c57e-41f4-8f60-b82b0ddfc6ee tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:48.860631 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-bfa81582-c57e-41f4-8f60-b82b0ddfc6ee tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:48.866849 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bfa81582-c57e-41f4-8f60-b82b0ddfc6ee tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:48.867297 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bfa81582-c57e-41f4-8f60-b82b0ddfc6ee tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:48.868053 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bfa81582-c57e-41f4-8f60-b82b0ddfc6ee tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:48.868479 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bfa81582-c57e-41f4-8f60-b82b0ddfc6ee tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:48.892843 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-bfa81582-c57e-41f4-8f60-b82b0ddfc6ee tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Going to try to terminate instance {{(pid=108259) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:19:48.984169 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-bfa81582-c57e-41f4-8f60-b82b0ddfc6ee tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 204 len: 0 microversion: 2.1 time: 0.127455 Oct 13 04:19:48.984963 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 187/377] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:19:48 2021] DELETE /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:19:48.993413 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ccfb31fc-5944-4e9c-ad10-1fab1bc2b780 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:48.994140 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ccfb31fc-5944-4e9c-ad10-1fab1bc2b780 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:49.000919 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ccfb31fc-5944-4e9c-ad10-1fab1bc2b780 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:49.001359 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ccfb31fc-5944-4e9c-ad10-1fab1bc2b780 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:49.002155 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ccfb31fc-5944-4e9c-ad10-1fab1bc2b780 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:49.002579 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ccfb31fc-5944-4e9c-ad10-1fab1bc2b780 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:49.133070 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-ccfb31fc-5944-4e9c-ad10-1fab1bc2b780 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:49.142511 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ccfb31fc-5944-4e9c-ad10-1fab1bc2b780 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1503 microversion: 2.1 time: 0.153141 Oct 13 04:19:49.143066 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 191/378] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:48 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:49.169271 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-edf53b89-d53b-4ad2-8dc0-4d70d3f0c8de tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:49.170175 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-edf53b89-d53b-4ad2-8dc0-4d70d3f0c8de tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:49.176779 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-edf53b89-d53b-4ad2-8dc0-4d70d3f0c8de tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:49.177699 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-edf53b89-d53b-4ad2-8dc0-4d70d3f0c8de tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:49.178681 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-edf53b89-d53b-4ad2-8dc0-4d70d3f0c8de tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:49.179318 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-edf53b89-d53b-4ad2-8dc0-4d70d3f0c8de tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:49.283597 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-edf53b89-d53b-4ad2-8dc0-4d70d3f0c8de tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.118373 Oct 13 04:19:49.284258 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 188/379] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:49 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:49.406166 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3acc0d64-7c1f-45c1-860d-c117fc823ebd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:49.406766 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3acc0d64-7c1f-45c1-860d-c117fc823ebd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:49.412980 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3acc0d64-7c1f-45c1-860d-c117fc823ebd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:49.413694 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3acc0d64-7c1f-45c1-860d-c117fc823ebd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:49.414292 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3acc0d64-7c1f-45c1-860d-c117fc823ebd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:49.414712 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3acc0d64-7c1f-45c1-860d-c117fc823ebd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:49.567397 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-3acc0d64-7c1f-45c1-860d-c117fc823ebd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:49.581005 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3acc0d64-7c1f-45c1-860d-c117fc823ebd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1321 microversion: 2.1 time: 0.178621 Oct 13 04:19:49.581586 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 192/380] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:49 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:49.723682 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b8bdd631-6ba3-45f6-8c97-adbd2d510c9d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:49.724971 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b8bdd631-6ba3-45f6-8c97-adbd2d510c9d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:49.734217 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b8bdd631-6ba3-45f6-8c97-adbd2d510c9d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:49.735599 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b8bdd631-6ba3-45f6-8c97-adbd2d510c9d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:49.735599 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b8bdd631-6ba3-45f6-8c97-adbd2d510c9d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:49.735872 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b8bdd631-6ba3-45f6-8c97-adbd2d510c9d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:49.817011 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b8bdd631-6ba3-45f6-8c97-adbd2d510c9d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.097040 Oct 13 04:19:49.817920 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 189/381] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:49 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:50.159159 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-49b5a639-1f5c-4b48-bd8e-3668114c3ddd tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:50.159669 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-49b5a639-1f5c-4b48-bd8e-3668114c3ddd tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:50.166345 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49b5a639-1f5c-4b48-bd8e-3668114c3ddd tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:50.166787 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49b5a639-1f5c-4b48-bd8e-3668114c3ddd tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:50.167524 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49b5a639-1f5c-4b48-bd8e-3668114c3ddd tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:50.167946 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-49b5a639-1f5c-4b48-bd8e-3668114c3ddd tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:50.286853 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-49b5a639-1f5c-4b48-bd8e-3668114c3ddd tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:50.294659 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-49b5a639-1f5c-4b48-bd8e-3668114c3ddd tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1503 microversion: 2.1 time: 0.139323 Oct 13 04:19:50.295228 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 193/382] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:50 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1503 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:50.296484 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-bd89fb31-8e15-457b-9a0d-51499697d235 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:50.297527 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-bd89fb31-8e15-457b-9a0d-51499697d235 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:50.304087 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bd89fb31-8e15-457b-9a0d-51499697d235 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:50.304521 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bd89fb31-8e15-457b-9a0d-51499697d235 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:50.305278 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bd89fb31-8e15-457b-9a0d-51499697d235 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:50.305727 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bd89fb31-8e15-457b-9a0d-51499697d235 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:50.542843 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-bd89fb31-8e15-457b-9a0d-51499697d235 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.250321 Oct 13 04:19:50.543490 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 190/383] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:50 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:19:50.599546 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5f847c61-7b80-4f71-81f6-13a1b379e52b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:50.600345 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5f847c61-7b80-4f71-81f6-13a1b379e52b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:50.608479 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5f847c61-7b80-4f71-81f6-13a1b379e52b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:50.608950 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5f847c61-7b80-4f71-81f6-13a1b379e52b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:50.609710 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5f847c61-7b80-4f71-81f6-13a1b379e52b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:50.610143 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5f847c61-7b80-4f71-81f6-13a1b379e52b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:50.735495 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5f847c61-7b80-4f71-81f6-13a1b379e52b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:50.746424 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5f847c61-7b80-4f71-81f6-13a1b379e52b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1321 microversion: 2.1 time: 0.151369 Oct 13 04:19:50.747174 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 194/384] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:50 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:50.834308 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d0077c87-d5dc-4726-b3e1-d2f472be374d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:50.835796 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d0077c87-d5dc-4726-b3e1-d2f472be374d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:50.846840 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0077c87-d5dc-4726-b3e1-d2f472be374d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:50.847565 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0077c87-d5dc-4726-b3e1-d2f472be374d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:50.848814 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0077c87-d5dc-4726-b3e1-d2f472be374d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:50.849512 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0077c87-d5dc-4726-b3e1-d2f472be374d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:51.163005 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d0077c87-d5dc-4726-b3e1-d2f472be374d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.335256 Oct 13 04:19:51.163584 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 191/385] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:50 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:51.312436 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-cbeaf59b-e2a6-427a-950c-5be8e8dea186 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:51.313102 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-cbeaf59b-e2a6-427a-950c-5be8e8dea186 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:51.319416 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cbeaf59b-e2a6-427a-950c-5be8e8dea186 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:51.319911 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cbeaf59b-e2a6-427a-950c-5be8e8dea186 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:51.320744 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cbeaf59b-e2a6-427a-950c-5be8e8dea186 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:51.321176 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cbeaf59b-e2a6-427a-950c-5be8e8dea186 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:51.445223 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-cbeaf59b-e2a6-427a-950c-5be8e8dea186 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:51.454504 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-cbeaf59b-e2a6-427a-950c-5be8e8dea186 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1503 microversion: 2.1 time: 0.146080 Oct 13 04:19:51.455073 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 195/386] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:51 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:51.555850 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c8821e07-0d15-4650-bcaf-86844fe8682f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:51.556846 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c8821e07-0d15-4650-bcaf-86844fe8682f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:51.564537 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c8821e07-0d15-4650-bcaf-86844fe8682f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:51.565673 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c8821e07-0d15-4650-bcaf-86844fe8682f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:51.566798 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c8821e07-0d15-4650-bcaf-86844fe8682f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:51.567240 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c8821e07-0d15-4650-bcaf-86844fe8682f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:51.636383 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c8821e07-0d15-4650-bcaf-86844fe8682f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.084404 Oct 13 04:19:51.640597 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 192/387] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:51 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:51.768354 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f69d71e1-f29b-4d19-9e09-8c773c130f19 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:51.768941 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f69d71e1-f29b-4d19-9e09-8c773c130f19 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:51.775207 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f69d71e1-f29b-4d19-9e09-8c773c130f19 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:51.775650 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f69d71e1-f29b-4d19-9e09-8c773c130f19 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:51.776404 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f69d71e1-f29b-4d19-9e09-8c773c130f19 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:51.776829 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f69d71e1-f29b-4d19-9e09-8c773c130f19 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:51.945115 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f69d71e1-f29b-4d19-9e09-8c773c130f19 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:51.954597 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f69d71e1-f29b-4d19-9e09-8c773c130f19 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1321 microversion: 2.1 time: 0.189557 Oct 13 04:19:51.955113 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 196/388] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:51 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:52.176725 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-97380bb7-b2af-4a3e-a37a-ae43c5e66d3d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:52.177741 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-97380bb7-b2af-4a3e-a37a-ae43c5e66d3d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:52.184662 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-97380bb7-b2af-4a3e-a37a-ae43c5e66d3d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:52.185263 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-97380bb7-b2af-4a3e-a37a-ae43c5e66d3d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:52.186031 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-97380bb7-b2af-4a3e-a37a-ae43c5e66d3d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:52.186466 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-97380bb7-b2af-4a3e-a37a-ae43c5e66d3d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:52.246476 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-2519b054-094e-4321-a6f8-196b3f6e4d90 req-57ecd082-8238-4d5b-bfb3-7905a80d4fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8147fc29-c466-4164-b49c-0f8c733a11f7", "name": "network-vif-deleted", "tag": "e954c7e7-2db7-4d12-91cb-5ee2d4db563c"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:52.248146 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:19:52.248146 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:19:52.255368 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-2519b054-094e-4321-a6f8-196b3f6e4d90 req-57ecd082-8238-4d5b-bfb3-7905a80d4fbc service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:52.255814 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-2519b054-094e-4321-a6f8-196b3f6e4d90 req-57ecd082-8238-4d5b-bfb3-7905a80d4fbc service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:52.266858 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-2519b054-094e-4321-a6f8-196b3f6e4d90 req-57ecd082-8238-4d5b-bfb3-7905a80d4fbc service nova] Creating event network-vif-deleted:e954c7e7-2db7-4d12-91cb-5ee2d4db563c for instance 8147fc29-c466-4164-b49c-0f8c733a11f7 on hv-cinder-81275 Oct 13 04:19:52.271611 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-2519b054-094e-4321-a6f8-196b3f6e4d90 req-57ecd082-8238-4d5b-bfb3-7905a80d4fbc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028800 Oct 13 04:19:52.272159 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 197/389] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:19:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:19:52.471736 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-0dcdde3e-f942-4c17-b74a-35eeb04562ab tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:52.472664 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-0dcdde3e-f942-4c17-b74a-35eeb04562ab tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:52.479027 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0dcdde3e-f942-4c17-b74a-35eeb04562ab tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:52.479479 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0dcdde3e-f942-4c17-b74a-35eeb04562ab tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:52.480200 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0dcdde3e-f942-4c17-b74a-35eeb04562ab tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:52.480632 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0dcdde3e-f942-4c17-b74a-35eeb04562ab tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:52.562645 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-0dcdde3e-f942-4c17-b74a-35eeb04562ab tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:52.573153 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-0dcdde3e-f942-4c17-b74a-35eeb04562ab tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1461 microversion: 2.1 time: 0.105313 Oct 13 04:19:52.573767 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 198/390] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:52 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1461 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:52.586563 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-97380bb7-b2af-4a3e-a37a-ae43c5e66d3d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.413985 Oct 13 04:19:52.591313 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 193/391] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:52 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:52.648278 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-416b950b-e90e-4f85-9ad4-2c709aed083b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:52.649547 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-416b950b-e90e-4f85-9ad4-2c709aed083b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:52.655736 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-416b950b-e90e-4f85-9ad4-2c709aed083b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:52.656369 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-416b950b-e90e-4f85-9ad4-2c709aed083b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:52.657320 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-416b950b-e90e-4f85-9ad4-2c709aed083b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:52.657931 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-416b950b-e90e-4f85-9ad4-2c709aed083b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:52.741017 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-416b950b-e90e-4f85-9ad4-2c709aed083b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.096239 Oct 13 04:19:52.742090 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 199/392] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:52 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:52.766965 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-b57c3c93-4dc4-4542-b2a0-e0461a4843b2 req-72dc51f7-3b17-4dcd-8a9f-d4353591c6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb288c24-304a-4fc1-bcbc-42dbfdec3fe1", "name": "network-vif-plugged", "status": "completed", "tag": "d06e81cd-60bd-4e5e-b109-0c41c2176eff"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:52.768733 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:19:52.768733 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:19:52.778317 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-b57c3c93-4dc4-4542-b2a0-e0461a4843b2 req-72dc51f7-3b17-4dcd-8a9f-d4353591c6c0 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:52.778998 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-b57c3c93-4dc4-4542-b2a0-e0461a4843b2 req-72dc51f7-3b17-4dcd-8a9f-d4353591c6c0 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:52.791010 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-b57c3c93-4dc4-4542-b2a0-e0461a4843b2 req-72dc51f7-3b17-4dcd-8a9f-d4353591c6c0 service nova] Creating event network-vif-plugged:d06e81cd-60bd-4e5e-b109-0c41c2176eff for instance cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 on hv-cinder-81275 Oct 13 04:19:52.800271 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-b57c3c93-4dc4-4542-b2a0-e0461a4843b2 req-72dc51f7-3b17-4dcd-8a9f-d4353591c6c0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037409 Oct 13 04:19:52.800934 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 194/393] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:19:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:52.971668 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3ede5bc9-b169-4afd-8e30-9a0e3ed18d7f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:52.972369 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3ede5bc9-b169-4afd-8e30-9a0e3ed18d7f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:52.979581 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3ede5bc9-b169-4afd-8e30-9a0e3ed18d7f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:52.980028 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3ede5bc9-b169-4afd-8e30-9a0e3ed18d7f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:52.980791 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3ede5bc9-b169-4afd-8e30-9a0e3ed18d7f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:52.981217 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3ede5bc9-b169-4afd-8e30-9a0e3ed18d7f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:53.112898 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-3ede5bc9-b169-4afd-8e30-9a0e3ed18d7f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:53.120385 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3ede5bc9-b169-4afd-8e30-9a0e3ed18d7f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1321 microversion: 2.1 time: 0.152785 Oct 13 04:19:53.121027 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 200/394] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:52 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:53.590633 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-da560664-d7d3-4cda-816c-e032bfecc9bc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:53.591343 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-da560664-d7d3-4cda-816c-e032bfecc9bc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:53.597732 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-da560664-d7d3-4cda-816c-e032bfecc9bc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:53.598169 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-da560664-d7d3-4cda-816c-e032bfecc9bc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:53.598906 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-da560664-d7d3-4cda-816c-e032bfecc9bc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:53.599419 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-44231718-f179-43c1-80e7-c53e997f8327 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:53.599552 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-da560664-d7d3-4cda-816c-e032bfecc9bc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:53.600493 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-44231718-f179-43c1-80e7-c53e997f8327 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:53.609198 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-44231718-f179-43c1-80e7-c53e997f8327 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:53.609762 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-44231718-f179-43c1-80e7-c53e997f8327 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:53.610777 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-44231718-f179-43c1-80e7-c53e997f8327 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:53.611456 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-44231718-f179-43c1-80e7-c53e997f8327 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:53.635067 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-da560664-d7d3-4cda-816c-e032bfecc9bc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:53.635602 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-da560664-d7d3-4cda-816c-e032bfecc9bc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:53.636137 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-da560664-d7d3-4cda-816c-e032bfecc9bc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lazy-loading 'fault' on Instance uuid 8147fc29-c466-4164-b49c-0f8c733a11f7 {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:19:53.682882 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-da560664-d7d3-4cda-816c-e032bfecc9bc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:53.690520 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-da560664-d7d3-4cda-816c-e032bfecc9bc tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1304 microversion: 2.1 time: 0.103888 Oct 13 04:19:53.691148 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 195/395] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:53 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:53.752188 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-675a4bd4-1af5-4c27-b77f-3bae5bd9bae5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:53.753186 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-675a4bd4-1af5-4c27-b77f-3bae5bd9bae5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:53.759212 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-675a4bd4-1af5-4c27-b77f-3bae5bd9bae5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:53.759642 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-675a4bd4-1af5-4c27-b77f-3bae5bd9bae5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:53.760393 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-675a4bd4-1af5-4c27-b77f-3bae5bd9bae5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:53.760807 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-675a4bd4-1af5-4c27-b77f-3bae5bd9bae5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:56.531328 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-44231718-f179-43c1-80e7-c53e997f8327 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 2.935389 Oct 13 04:19:56.533075 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 201/396] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:53 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 2938 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:56.536107 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-675a4bd4-1af5-4c27-b77f-3bae5bd9bae5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 2.787436 Oct 13 04:19:56.540354 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 196/397] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:53 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 2789 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:19:56.540533 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1d95e4b5-5cfc-439a-ac55-c5d203566a70 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:56.540533 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-1d95e4b5-5cfc-439a-ac55-c5d203566a70 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:56.541852 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-07c836bd-cb4a-4fe5-82ec-53dec4089f54 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:56.542562 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-07c836bd-cb4a-4fe5-82ec-53dec4089f54 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:56.553104 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-07c836bd-cb4a-4fe5-82ec-53dec4089f54 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:56.553539 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-07c836bd-cb4a-4fe5-82ec-53dec4089f54 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:56.554348 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-07c836bd-cb4a-4fe5-82ec-53dec4089f54 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:56.554795 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-07c836bd-cb4a-4fe5-82ec-53dec4089f54 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:56.558991 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1d95e4b5-5cfc-439a-ac55-c5d203566a70 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:56.559432 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1d95e4b5-5cfc-439a-ac55-c5d203566a70 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:56.560246 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1d95e4b5-5cfc-439a-ac55-c5d203566a70 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:56.560610 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1d95e4b5-5cfc-439a-ac55-c5d203566a70 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:56.592075 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-07c836bd-cb4a-4fe5-82ec-53dec4089f54 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:56.592778 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-07c836bd-cb4a-4fe5-82ec-53dec4089f54 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:56.593403 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-07c836bd-cb4a-4fe5-82ec-53dec4089f54 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lazy-loading 'fault' on Instance uuid 8147fc29-c466-4164-b49c-0f8c733a11f7 {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:19:56.647146 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-07c836bd-cb4a-4fe5-82ec-53dec4089f54 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6739d1337a744567827491ebc371f05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d2cdcae4c64be48feb38880725cda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:56.655116 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-07c836bd-cb4a-4fe5-82ec-53dec4089f54 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 200 len: 1304 microversion: 2.1 time: 0.116921 Oct 13 04:19:56.655683 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 197/398] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:56 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:56.660251 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-571af321-eedb-4cdd-985e-9625212f4f3d req-af4655f8-f3cf-4409-acb2-c0830e642686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b4223c8-bfe1-440e-89bc-7158a1490e1c", "name": "network-vif-plugged", "status": "completed", "tag": "a005bba9-2263-44ad-abba-36d29b7c7e7c"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:56.662193 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:19:56.662193 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:19:56.669567 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-571af321-eedb-4cdd-985e-9625212f4f3d req-af4655f8-f3cf-4409-acb2-c0830e642686 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:56.670039 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-571af321-eedb-4cdd-985e-9625212f4f3d req-af4655f8-f3cf-4409-acb2-c0830e642686 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:56.680932 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-571af321-eedb-4cdd-985e-9625212f4f3d req-af4655f8-f3cf-4409-acb2-c0830e642686 service nova] Creating event network-vif-plugged:a005bba9-2263-44ad-abba-36d29b7c7e7c for instance 2b4223c8-bfe1-440e-89bc-7158a1490e1c on hv-cinder-81275 Oct 13 04:19:56.686103 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-571af321-eedb-4cdd-985e-9625212f4f3d req-af4655f8-f3cf-4409-acb2-c0830e642686 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029223 Oct 13 04:19:56.686964 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 198/399] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:19:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:19:56.713881 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-1d95e4b5-5cfc-439a-ac55-c5d203566a70 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:56.721205 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-1d95e4b5-5cfc-439a-ac55-c5d203566a70 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1321 microversion: 2.1 time: 0.186742 Oct 13 04:19:56.721771 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 202/400] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:56 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:57.547821 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-70740ce7-ccfc-4ae9-a2b3-cc44397ffabe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:57.548886 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-70740ce7-ccfc-4ae9-a2b3-cc44397ffabe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:57.549145 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e3e2de34-ea79-4a8b-8875-56d1a2c25f40 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:57.550057 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e3e2de34-ea79-4a8b-8875-56d1a2c25f40 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:57.556236 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-70740ce7-ccfc-4ae9-a2b3-cc44397ffabe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:57.556534 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e3e2de34-ea79-4a8b-8875-56d1a2c25f40 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:57.556692 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-70740ce7-ccfc-4ae9-a2b3-cc44397ffabe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:57.556970 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e3e2de34-ea79-4a8b-8875-56d1a2c25f40 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:57.557442 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-70740ce7-ccfc-4ae9-a2b3-cc44397ffabe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:57.557765 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e3e2de34-ea79-4a8b-8875-56d1a2c25f40 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:57.557897 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-70740ce7-ccfc-4ae9-a2b3-cc44397ffabe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:57.558188 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e3e2de34-ea79-4a8b-8875-56d1a2c25f40 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:57.944940 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e3e2de34-ea79-4a8b-8875-56d1a2c25f40 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.398942 Oct 13 04:19:57.946003 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 203/401] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:57 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:57.948963 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-70740ce7-ccfc-4ae9-a2b3-cc44397ffabe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.406159 Oct 13 04:19:57.950696 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 199/402] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:57 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:57.953804 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-011215f8-7d4d-48d8-b6dc-5ad2b21d7ac6 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:57.954921 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-011215f8-7d4d-48d8-b6dc-5ad2b21d7ac6 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] [instance: 8147fc29-c466-4164-b49c-0f8c733a11f7] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:57.959040 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-19d65f24-cf93-4798-8f9c-e14455dc67f5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:57.960357 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-19d65f24-cf93-4798-8f9c-e14455dc67f5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:57.965556 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-011215f8-7d4d-48d8-b6dc-5ad2b21d7ac6 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:57.966515 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-011215f8-7d4d-48d8-b6dc-5ad2b21d7ac6 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:57.967279 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-011215f8-7d4d-48d8-b6dc-5ad2b21d7ac6 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:57.967694 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-011215f8-7d4d-48d8-b6dc-5ad2b21d7ac6 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:57.969155 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-19d65f24-cf93-4798-8f9c-e14455dc67f5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:57.969647 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-19d65f24-cf93-4798-8f9c-e14455dc67f5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:57.970438 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-19d65f24-cf93-4798-8f9c-e14455dc67f5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:57.970866 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-19d65f24-cf93-4798-8f9c-e14455dc67f5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:57.981156 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-011215f8-7d4d-48d8-b6dc-5ad2b21d7ac6 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] HTTP exception thrown: Instance 8147fc29-c466-4164-b49c-0f8c733a11f7 could not be found. Oct 13 04:19:57.981677 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-011215f8-7d4d-48d8-b6dc-5ad2b21d7ac6 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] Returning 404 to user: Instance 8147fc29-c466-4164-b49c-0f8c733a11f7 could not be found. {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:19:57.982498 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-011215f8-7d4d-48d8-b6dc-5ad2b21d7ac6 tempest-VolumesActionsTest-465070686 tempest-VolumesActionsTest-465070686-project] 10.222.0.55 "GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7" status: 404 len: 111 microversion: 2.1 time: 0.035102 Oct 13 04:19:57.983038 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 204/403] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:57 2021] GET /compute/v2.1/servers/8147fc29-c466-4164-b49c-0f8c733a11f7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:19:58.094951 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-19d65f24-cf93-4798-8f9c-e14455dc67f5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:58.102840 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-19d65f24-cf93-4798-8f9c-e14455dc67f5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1321 microversion: 2.1 time: 0.150948 Oct 13 04:19:58.103422 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 200/404] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:57 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:58.959187 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a508f8c4-1907-4a22-bc28-e9fadd532a52 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:58.960128 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a508f8c4-1907-4a22-bc28-e9fadd532a52 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:58.964380 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b215b390-b509-48b6-8fba-e404b08ee973 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:58.965284 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b215b390-b509-48b6-8fba-e404b08ee973 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:58.966935 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a508f8c4-1907-4a22-bc28-e9fadd532a52 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:58.967385 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a508f8c4-1907-4a22-bc28-e9fadd532a52 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:58.968154 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a508f8c4-1907-4a22-bc28-e9fadd532a52 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:58.968587 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a508f8c4-1907-4a22-bc28-e9fadd532a52 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:58.971979 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b215b390-b509-48b6-8fba-e404b08ee973 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:58.972424 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b215b390-b509-48b6-8fba-e404b08ee973 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:58.973179 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b215b390-b509-48b6-8fba-e404b08ee973 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:58.973600 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b215b390-b509-48b6-8fba-e404b08ee973 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:59.109553 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a508f8c4-1907-4a22-bc28-e9fadd532a52 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.153952 Oct 13 04:19:59.110245 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 205/405] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:19:58 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:19:59.114250 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b215b390-b509-48b6-8fba-e404b08ee973 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.153353 Oct 13 04:19:59.114941 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 201/406] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:19:58 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:19:59.120800 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3ef5dc12-40fe-4082-bcf9-62de59848ede tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:19:59.121821 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3ef5dc12-40fe-4082-bcf9-62de59848ede tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:59.128800 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3ef5dc12-40fe-4082-bcf9-62de59848ede tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:59.129347 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3ef5dc12-40fe-4082-bcf9-62de59848ede tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:59.130140 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3ef5dc12-40fe-4082-bcf9-62de59848ede tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:59.130616 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3ef5dc12-40fe-4082-bcf9-62de59848ede tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:59.255489 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-3ef5dc12-40fe-4082-bcf9-62de59848ede tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:19:59.262914 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3ef5dc12-40fe-4082-bcf9-62de59848ede tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1321 microversion: 2.1 time: 0.146386 Oct 13 04:19:59.263467 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 206/407] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:19:59 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:19:59.938046 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-506d91ea-915d-4fd4-a673-7d98a6326e0f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c92728c2-58a8-414d-879d-737fa04db23c"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:19:59.939186 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-506d91ea-915d-4fd4-a673-7d98a6326e0f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:19:59.946090 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-506d91ea-915d-4fd4-a673-7d98a6326e0f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:59.946530 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-506d91ea-915d-4fd4-a673-7d98a6326e0f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:19:59.947315 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-506d91ea-915d-4fd4-a673-7d98a6326e0f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:19:59.947742 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-506d91ea-915d-4fd4-a673-7d98a6326e0f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:00.033225 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-506d91ea-915d-4fd4-a673-7d98a6326e0f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] HTTP exception thrown: Invalid volume: volume c92728c2-58a8-414d-879d-737fa04db23c is already attached to instances: d58316e9-818c-4986-9148-932d51f34cc9 Oct 13 04:20:00.033874 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-506d91ea-915d-4fd4-a673-7d98a6326e0f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Returning 400 to user: Invalid volume: volume c92728c2-58a8-414d-879d-737fa04db23c is already attached to instances: d58316e9-818c-4986-9148-932d51f34cc9 {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:20:00.034681 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-506d91ea-915d-4fd4-a673-7d98a6326e0f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "POST /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103147 Oct 13 04:20:00.035207 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 202/408] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Oct 13 04:19:59 2021] POST /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 04:20:00.092884 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e9e0a9b5-f99e-4856-9113-cac85ea62c4a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:00.093422 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e9e0a9b5-f99e-4856-9113-cac85ea62c4a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:00.099401 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e9e0a9b5-f99e-4856-9113-cac85ea62c4a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:00.099829 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e9e0a9b5-f99e-4856-9113-cac85ea62c4a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:00.100636 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e9e0a9b5-f99e-4856-9113-cac85ea62c4a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:00.101097 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e9e0a9b5-f99e-4856-9113-cac85ea62c4a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:00.128737 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-9bb16f2c-8101-4f3b-8fed-e1dd2890b64d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:00.135114 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-9bb16f2c-8101-4f3b-8fed-e1dd2890b64d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:00.143413 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9bb16f2c-8101-4f3b-8fed-e1dd2890b64d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:00.144000 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9bb16f2c-8101-4f3b-8fed-e1dd2890b64d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:00.144916 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9bb16f2c-8101-4f3b-8fed-e1dd2890b64d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:00.145426 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9bb16f2c-8101-4f3b-8fed-e1dd2890b64d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:00.226077 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.objects.instance [None req-e9e0a9b5-f99e-4856-9113-cac85ea62c4a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lazy-loading 'services' on Instance uuid d58316e9-818c-4986-9148-932d51f34cc9 {{(pid=108260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:20:00.261309 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-9bb16f2c-8101-4f3b-8fed-e1dd2890b64d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.140094 Oct 13 04:20:00.262000 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 203/409] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:00 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:00.267077 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d49be640-01ab-4ed3-90db-c39d0e5bc1fc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:00.268056 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d49be640-01ab-4ed3-90db-c39d0e5bc1fc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:00.275774 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d49be640-01ab-4ed3-90db-c39d0e5bc1fc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:00.276409 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d49be640-01ab-4ed3-90db-c39d0e5bc1fc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:00.277666 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d49be640-01ab-4ed3-90db-c39d0e5bc1fc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:00.278268 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d49be640-01ab-4ed3-90db-c39d0e5bc1fc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:00.344633 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e9e0a9b5-f99e-4856-9113-cac85ea62c4a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments/c92728c2-58a8-414d-879d-737fa04db23c" status: 202 len: 0 microversion: 2.1 time: 0.255419 Oct 13 04:20:00.345213 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 207/410] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Oct 13 04:20:00 2021] DELETE /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments/c92728c2-58a8-414d-879d-737fa04db23c => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:00.349955 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a37e6c4f-038c-40b2-86b0-2c5be230eeaa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:00.350637 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a37e6c4f-038c-40b2-86b0-2c5be230eeaa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:00.356892 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a37e6c4f-038c-40b2-86b0-2c5be230eeaa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:00.357331 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a37e6c4f-038c-40b2-86b0-2c5be230eeaa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:00.358107 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a37e6c4f-038c-40b2-86b0-2c5be230eeaa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:00.358538 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a37e6c4f-038c-40b2-86b0-2c5be230eeaa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:00.427390 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d49be640-01ab-4ed3-90db-c39d0e5bc1fc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.163938 Oct 13 04:20:00.428082 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 204/411] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:00 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:00.435252 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8aaf637a-4836-464f-9ddf-0d0484388928 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:00.435699 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-8aaf637a-4836-464f-9ddf-0d0484388928 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:00.442602 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8aaf637a-4836-464f-9ddf-0d0484388928 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:00.443047 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8aaf637a-4836-464f-9ddf-0d0484388928 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:00.443819 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8aaf637a-4836-464f-9ddf-0d0484388928 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:00.444791 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8aaf637a-4836-464f-9ddf-0d0484388928 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:00.476520 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-8aaf637a-4836-464f-9ddf-0d0484388928 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047112 Oct 13 04:20:00.477273 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 205/412] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:20:00 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:20:00.499641 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a37e6c4f-038c-40b2-86b0-2c5be230eeaa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:00.507174 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a37e6c4f-038c-40b2-86b0-2c5be230eeaa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1514 microversion: 2.1 time: 0.160823 Oct 13 04:20:00.507854 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 208/413] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:00 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:00.525016 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7c1014ac-b825-4e4a-adef-730bb7e2c55b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:00.525997 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7c1014ac-b825-4e4a-adef-730bb7e2c55b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:00.531763 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7c1014ac-b825-4e4a-adef-730bb7e2c55b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:00.532212 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7c1014ac-b825-4e4a-adef-730bb7e2c55b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:00.533006 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7c1014ac-b825-4e4a-adef-730bb7e2c55b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:00.533434 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7c1014ac-b825-4e4a-adef-730bb7e2c55b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:00.556131 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-7c1014ac-b825-4e4a-adef-730bb7e2c55b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lazy-loading 'flavor' on Instance uuid cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:20:00.669039 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7c1014ac-b825-4e4a-adef-730bb7e2c55b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "POST /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1/action" status: 200 len: 32 microversion: 2.1 time: 0.147908 Oct 13 04:20:00.669658 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 206/414] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:00 2021] POST /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1/action => generated 32 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:20:00.678518 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c8140e8f-0da4-494d-989a-6c3e83cc197e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:00.679950 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c8140e8f-0da4-494d-989a-6c3e83cc197e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:00.686435 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c8140e8f-0da4-494d-989a-6c3e83cc197e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:00.686863 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c8140e8f-0da4-494d-989a-6c3e83cc197e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:00.687630 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c8140e8f-0da4-494d-989a-6c3e83cc197e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:00.688036 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c8140e8f-0da4-494d-989a-6c3e83cc197e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:00.839188 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-c8140e8f-0da4-494d-989a-6c3e83cc197e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:00.846988 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c8140e8f-0da4-494d-989a-6c3e83cc197e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.172192 Oct 13 04:20:00.847558 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 209/415] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:00 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:20:01.273283 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b6ad3cb6-e0e0-4f05-8351-30be0a52367a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:01.274716 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b6ad3cb6-e0e0-4f05-8351-30be0a52367a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:01.281789 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b6ad3cb6-e0e0-4f05-8351-30be0a52367a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:01.282234 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b6ad3cb6-e0e0-4f05-8351-30be0a52367a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:01.283004 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b6ad3cb6-e0e0-4f05-8351-30be0a52367a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:01.283399 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b6ad3cb6-e0e0-4f05-8351-30be0a52367a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:01.369632 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b6ad3cb6-e0e0-4f05-8351-30be0a52367a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.100396 Oct 13 04:20:01.372228 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 207/416] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:01 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:01.442593 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9e811241-038d-4169-b27a-5fc57b630669 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:01.444142 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9e811241-038d-4169-b27a-5fc57b630669 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:01.454140 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9e811241-038d-4169-b27a-5fc57b630669 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:01.454869 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9e811241-038d-4169-b27a-5fc57b630669 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:01.456124 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9e811241-038d-4169-b27a-5fc57b630669 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:01.456819 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9e811241-038d-4169-b27a-5fc57b630669 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:01.488980 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-34ea320a-c703-4542-a8c8-c3f063cf4504 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:01.490046 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-34ea320a-c703-4542-a8c8-c3f063cf4504 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:01.496897 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-34ea320a-c703-4542-a8c8-c3f063cf4504 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:01.497353 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-34ea320a-c703-4542-a8c8-c3f063cf4504 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:01.498163 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-34ea320a-c703-4542-a8c8-c3f063cf4504 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:01.498628 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-34ea320a-c703-4542-a8c8-c3f063cf4504 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:01.520669 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9e811241-038d-4169-b27a-5fc57b630669 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.084117 Oct 13 04:20:01.524963 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 210/417] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:01 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:01.527662 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-34ea320a-c703-4542-a8c8-c3f063cf4504 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042856 Oct 13 04:20:01.528225 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 208/418] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:20:01 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:20:01.871124 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-bdb6724e-c113-48ce-b46e-3df72458429d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:01.872211 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-bdb6724e-c113-48ce-b46e-3df72458429d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:01.882985 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bdb6724e-c113-48ce-b46e-3df72458429d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:01.883709 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bdb6724e-c113-48ce-b46e-3df72458429d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:01.884951 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bdb6724e-c113-48ce-b46e-3df72458429d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:01.885688 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bdb6724e-c113-48ce-b46e-3df72458429d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:02.006945 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-bdb6724e-c113-48ce-b46e-3df72458429d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:02.014999 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-bdb6724e-c113-48ce-b46e-3df72458429d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.150675 Oct 13 04:20:02.015565 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 211/419] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:01 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:02.381717 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e32b7e8f-c66e-4819-b1fc-0b89bf35b581 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:02.382664 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e32b7e8f-c66e-4819-b1fc-0b89bf35b581 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:02.389033 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e32b7e8f-c66e-4819-b1fc-0b89bf35b581 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:02.389475 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e32b7e8f-c66e-4819-b1fc-0b89bf35b581 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:02.390264 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e32b7e8f-c66e-4819-b1fc-0b89bf35b581 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:02.390691 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e32b7e8f-c66e-4819-b1fc-0b89bf35b581 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:02.452973 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e32b7e8f-c66e-4819-b1fc-0b89bf35b581 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.074951 Oct 13 04:20:02.453591 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 209/420] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:02 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:02.533912 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-59fd134a-0eb1-437a-b19b-6082eb3a9853 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:02.535144 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-59fd134a-0eb1-437a-b19b-6082eb3a9853 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:02.540421 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-91973c16-9f2a-456d-8b95-6e1b7592b55a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:02.541461 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-91973c16-9f2a-456d-8b95-6e1b7592b55a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:02.542137 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-59fd134a-0eb1-437a-b19b-6082eb3a9853 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:02.542596 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-59fd134a-0eb1-437a-b19b-6082eb3a9853 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:02.543390 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-59fd134a-0eb1-437a-b19b-6082eb3a9853 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:02.543834 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-59fd134a-0eb1-437a-b19b-6082eb3a9853 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:02.552213 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-91973c16-9f2a-456d-8b95-6e1b7592b55a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:02.552673 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-91973c16-9f2a-456d-8b95-6e1b7592b55a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:02.553462 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-91973c16-9f2a-456d-8b95-6e1b7592b55a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:02.553934 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-91973c16-9f2a-456d-8b95-6e1b7592b55a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:02.584047 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-91973c16-9f2a-456d-8b95-6e1b7592b55a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048214 Oct 13 04:20:02.584624 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 210/421] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:20:02 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:20:03.032273 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4b21f8ba-e4ed-409d-b437-afbcaa4fa3c9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:03.032901 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4b21f8ba-e4ed-409d-b437-afbcaa4fa3c9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:03.039675 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4b21f8ba-e4ed-409d-b437-afbcaa4fa3c9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:03.040118 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4b21f8ba-e4ed-409d-b437-afbcaa4fa3c9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:03.040874 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4b21f8ba-e4ed-409d-b437-afbcaa4fa3c9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:03.041302 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4b21f8ba-e4ed-409d-b437-afbcaa4fa3c9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:03.171333 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-4b21f8ba-e4ed-409d-b437-afbcaa4fa3c9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:03.179095 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4b21f8ba-e4ed-409d-b437-afbcaa4fa3c9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.150670 Oct 13 04:20:03.179652 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 211/422] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:03 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:03.467742 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-81ebad5c-1e29-4c2d-973f-0279958162b2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:03.469195 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-81ebad5c-1e29-4c2d-973f-0279958162b2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:03.479168 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-81ebad5c-1e29-4c2d-973f-0279958162b2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:03.479895 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-81ebad5c-1e29-4c2d-973f-0279958162b2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:03.481130 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-81ebad5c-1e29-4c2d-973f-0279958162b2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:03.481816 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-81ebad5c-1e29-4c2d-973f-0279958162b2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:07.383706 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-59fd134a-0eb1-437a-b19b-6082eb3a9853 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 4.853177 Oct 13 04:20:07.384362 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 212/423] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:02 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 4855 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:07.390335 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-83a8efb2-8434-4f47-a033-b912c55a59eb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:07.391310 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-83a8efb2-8434-4f47-a033-b912c55a59eb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:07.398029 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-83a8efb2-8434-4f47-a033-b912c55a59eb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:07.398470 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-83a8efb2-8434-4f47-a033-b912c55a59eb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:07.399226 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-83a8efb2-8434-4f47-a033-b912c55a59eb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:07.399648 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-83a8efb2-8434-4f47-a033-b912c55a59eb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:07.418649 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-81ebad5c-1e29-4c2d-973f-0279958162b2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 3.957044 Oct 13 04:20:07.419396 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 212/424] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:03 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 3959 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:07.424309 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2a404a15-2577-4371-b1be-572934a43e70 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:07.425023 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2a404a15-2577-4371-b1be-572934a43e70 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:07.429335 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-83a8efb2-8434-4f47-a033-b912c55a59eb tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043705 Oct 13 04:20:07.430150 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 213/425] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:20:07 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:20:07.431557 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2a404a15-2577-4371-b1be-572934a43e70 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:07.432004 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2a404a15-2577-4371-b1be-572934a43e70 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:07.432770 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2a404a15-2577-4371-b1be-572934a43e70 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:07.433192 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2a404a15-2577-4371-b1be-572934a43e70 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:07.569499 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2a404a15-2577-4371-b1be-572934a43e70 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:07.577308 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2a404a15-2577-4371-b1be-572934a43e70 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.156781 Oct 13 04:20:07.577875 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 213/426] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:07 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:08.397128 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7ce3077d-4835-4423-ab04-1a78eea89791 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:08.398200 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7ce3077d-4835-4423-ab04-1a78eea89791 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:08.405505 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7ce3077d-4835-4423-ab04-1a78eea89791 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:08.405962 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7ce3077d-4835-4423-ab04-1a78eea89791 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:08.406714 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7ce3077d-4835-4423-ab04-1a78eea89791 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:08.407184 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7ce3077d-4835-4423-ab04-1a78eea89791 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:08.430033 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8d7ba31f-e341-4585-8f20-023ddbac22a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:08.430939 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-8d7ba31f-e341-4585-8f20-023ddbac22a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:08.438292 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8d7ba31f-e341-4585-8f20-023ddbac22a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:08.438734 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8d7ba31f-e341-4585-8f20-023ddbac22a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:08.439494 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8d7ba31f-e341-4585-8f20-023ddbac22a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:08.439904 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8d7ba31f-e341-4585-8f20-023ddbac22a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:08.504891 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7ce3077d-4835-4423-ab04-1a78eea89791 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.111230 Oct 13 04:20:08.505961 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 214/427] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:08 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:08.513982 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b9196cb0-d40b-466f-ba31-2727c8eda5b3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:08.515123 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b9196cb0-d40b-466f-ba31-2727c8eda5b3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:08.520446 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-8d7ba31f-e341-4585-8f20-023ddbac22a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.093818 Oct 13 04:20:08.521184 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 214/428] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:08 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:08.521579 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b9196cb0-d40b-466f-ba31-2727c8eda5b3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:08.522042 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b9196cb0-d40b-466f-ba31-2727c8eda5b3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:08.522838 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b9196cb0-d40b-466f-ba31-2727c8eda5b3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:08.523265 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b9196cb0-d40b-466f-ba31-2727c8eda5b3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:08.554722 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b9196cb0-d40b-466f-ba31-2727c8eda5b3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047172 Oct 13 04:20:08.555295 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 215/429] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:20:08 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:20:08.595610 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ba1103f5-e3e3-4b24-abe5-9f93c9e6fd80 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:08.596298 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ba1103f5-e3e3-4b24-abe5-9f93c9e6fd80 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:08.603150 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ba1103f5-e3e3-4b24-abe5-9f93c9e6fd80 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:08.603595 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ba1103f5-e3e3-4b24-abe5-9f93c9e6fd80 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:08.604354 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ba1103f5-e3e3-4b24-abe5-9f93c9e6fd80 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:08.604783 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ba1103f5-e3e3-4b24-abe5-9f93c9e6fd80 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:08.735868 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ba1103f5-e3e3-4b24-abe5-9f93c9e6fd80 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:08.743252 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ba1103f5-e3e3-4b24-abe5-9f93c9e6fd80 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.151742 Oct 13 04:20:08.743811 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 215/430] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:08 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:09.519597 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-797aadf8-61a6-4ed4-93a8-2760b51cd111 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:09.520657 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-797aadf8-61a6-4ed4-93a8-2760b51cd111 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:09.527439 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-797aadf8-61a6-4ed4-93a8-2760b51cd111 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:09.527886 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-797aadf8-61a6-4ed4-93a8-2760b51cd111 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:09.528642 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-797aadf8-61a6-4ed4-93a8-2760b51cd111 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:09.529067 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-797aadf8-61a6-4ed4-93a8-2760b51cd111 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:09.532547 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c3f20f79-5fa0-476a-b221-009baefffb29 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:09.533531 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c3f20f79-5fa0-476a-b221-009baefffb29 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:09.539938 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c3f20f79-5fa0-476a-b221-009baefffb29 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:09.540381 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c3f20f79-5fa0-476a-b221-009baefffb29 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:09.541137 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c3f20f79-5fa0-476a-b221-009baefffb29 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:09.541565 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c3f20f79-5fa0-476a-b221-009baefffb29 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:13.495142 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-797aadf8-61a6-4ed4-93a8-2760b51cd111 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 3.978665 Oct 13 04:20:13.496175 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 216/431] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:09 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 3981 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:13.502537 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f3b5389a-5ff2-4d5c-abb4-04e5c6c95a1f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:13.503565 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f3b5389a-5ff2-4d5c-abb4-04e5c6c95a1f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:13.510469 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f3b5389a-5ff2-4d5c-abb4-04e5c6c95a1f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:13.510934 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f3b5389a-5ff2-4d5c-abb4-04e5c6c95a1f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:13.511751 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f3b5389a-5ff2-4d5c-abb4-04e5c6c95a1f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:13.512168 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f3b5389a-5ff2-4d5c-abb4-04e5c6c95a1f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:13.518961 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c3f20f79-5fa0-476a-b221-009baefffb29 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 3.989956 Oct 13 04:20:13.519682 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 216/432] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:09 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 3992 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:13.524791 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0f320f05-799c-491e-8654-d13eea826398 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:13.525522 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0f320f05-799c-491e-8654-d13eea826398 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:13.532911 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f320f05-799c-491e-8654-d13eea826398 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:13.533371 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f320f05-799c-491e-8654-d13eea826398 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:13.534171 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f320f05-799c-491e-8654-d13eea826398 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:13.534632 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f320f05-799c-491e-8654-d13eea826398 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:13.544298 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f3b5389a-5ff2-4d5c-abb4-04e5c6c95a1f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046269 Oct 13 04:20:13.548345 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 217/433] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:20:13 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:20:13.656265 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-0f320f05-799c-491e-8654-d13eea826398 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:13.664229 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0f320f05-799c-491e-8654-d13eea826398 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.143414 Oct 13 04:20:13.664770 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 217/434] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:13 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:14.511984 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-50b0b65a-195c-4d64-b024-4201499d49c2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:14.513456 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-50b0b65a-195c-4d64-b024-4201499d49c2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:14.520348 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-50b0b65a-195c-4d64-b024-4201499d49c2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:14.520787 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-50b0b65a-195c-4d64-b024-4201499d49c2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:14.521549 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-50b0b65a-195c-4d64-b024-4201499d49c2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:14.522002 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-50b0b65a-195c-4d64-b024-4201499d49c2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:14.531072 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0def650f-73ac-47d8-9709-ba5d77c94c20 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:14.531985 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0def650f-73ac-47d8-9709-ba5d77c94c20 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:14.538840 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0def650f-73ac-47d8-9709-ba5d77c94c20 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:14.539285 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0def650f-73ac-47d8-9709-ba5d77c94c20 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:14.540034 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0def650f-73ac-47d8-9709-ba5d77c94c20 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:14.540460 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0def650f-73ac-47d8-9709-ba5d77c94c20 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:14.641302 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-50b0b65a-195c-4d64-b024-4201499d49c2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.135042 Oct 13 04:20:14.642383 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 218/435] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:14 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:14.650528 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a95dd7e5-0760-4711-846c-14f872fc4dac tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:14.652050 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0def650f-73ac-47d8-9709-ba5d77c94c20 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.123983 Oct 13 04:20:14.652481 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a95dd7e5-0760-4711-846c-14f872fc4dac tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:14.653418 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 218/436] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:14 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:14.663729 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a95dd7e5-0760-4711-846c-14f872fc4dac tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:14.664816 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a95dd7e5-0760-4711-846c-14f872fc4dac tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:14.667044 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a95dd7e5-0760-4711-846c-14f872fc4dac tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:14.668317 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a95dd7e5-0760-4711-846c-14f872fc4dac tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:14.682775 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1eabb050-32e0-43b3-bb76-7b9bc9cffd49 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:14.684913 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1eabb050-32e0-43b3-bb76-7b9bc9cffd49 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:14.692135 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1eabb050-32e0-43b3-bb76-7b9bc9cffd49 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:14.692604 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1eabb050-32e0-43b3-bb76-7b9bc9cffd49 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:14.693408 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1eabb050-32e0-43b3-bb76-7b9bc9cffd49 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:14.693882 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1eabb050-32e0-43b3-bb76-7b9bc9cffd49 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:14.710842 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a95dd7e5-0760-4711-846c-14f872fc4dac tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066722 Oct 13 04:20:14.712044 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 219/437] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:20:14 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:20:14.840076 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1eabb050-32e0-43b3-bb76-7b9bc9cffd49 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:14.847894 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1eabb050-32e0-43b3-bb76-7b9bc9cffd49 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.170353 Oct 13 04:20:14.848454 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 219/438] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:14 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:20:15.656028 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-0ec5c38a-e839-468e-b868-2ca85eddac7e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:15.656936 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-0ec5c38a-e839-468e-b868-2ca85eddac7e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:15.663686 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0ec5c38a-e839-468e-b868-2ca85eddac7e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:15.664124 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0ec5c38a-e839-468e-b868-2ca85eddac7e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:15.664885 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0ec5c38a-e839-468e-b868-2ca85eddac7e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:15.665306 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0ec5c38a-e839-468e-b868-2ca85eddac7e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:15.666931 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-9b9ca44d-2548-4aae-8a72-bdc05050d2ae tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:15.667839 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-9b9ca44d-2548-4aae-8a72-bdc05050d2ae tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:15.673841 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9b9ca44d-2548-4aae-8a72-bdc05050d2ae tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:15.674282 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9b9ca44d-2548-4aae-8a72-bdc05050d2ae tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:15.675033 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9b9ca44d-2548-4aae-8a72-bdc05050d2ae tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:15.675458 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9b9ca44d-2548-4aae-8a72-bdc05050d2ae tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:15.752045 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-0ec5c38a-e839-468e-b868-2ca85eddac7e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.099619 Oct 13 04:20:15.756104 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 220/439] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:15 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:20:15.757734 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-dcb76ecd-6b2f-4a45-b3c9-7008c1aaef9f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:15.758730 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-dcb76ecd-6b2f-4a45-b3c9-7008c1aaef9f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:15.761854 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-9b9ca44d-2548-4aae-8a72-bdc05050d2ae tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.098350 Oct 13 04:20:15.762542 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 220/440] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:15 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:15.765182 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dcb76ecd-6b2f-4a45-b3c9-7008c1aaef9f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:15.765641 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dcb76ecd-6b2f-4a45-b3c9-7008c1aaef9f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:15.766397 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dcb76ecd-6b2f-4a45-b3c9-7008c1aaef9f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:15.766812 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dcb76ecd-6b2f-4a45-b3c9-7008c1aaef9f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:15.796552 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-dcb76ecd-6b2f-4a45-b3c9-7008c1aaef9f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042603 Oct 13 04:20:15.797246 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 221/441] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:20:15 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:20:15.864543 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f2b9fefe-3991-4f62-a494-0afac3afc7fa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:15.865212 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f2b9fefe-3991-4f62-a494-0afac3afc7fa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:15.872019 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f2b9fefe-3991-4f62-a494-0afac3afc7fa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:15.872619 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f2b9fefe-3991-4f62-a494-0afac3afc7fa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:15.873814 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f2b9fefe-3991-4f62-a494-0afac3afc7fa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:15.874395 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f2b9fefe-3991-4f62-a494-0afac3afc7fa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:15.970033 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-95bb6085-edef-4094-b559-b7ddca3c0a28 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1602120031", "imageRef": "4f468f34-171a-4b6e-a0cd-2e4c6fcda23d", "flavorRef": "452", "networks": [{"uuid": "0d1ab067-7575-4c07-97ac-3bce9cca9c59"}]}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:16.010619 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f2b9fefe-3991-4f62-a494-0afac3afc7fa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:16.022876 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f2b9fefe-3991-4f62-a494-0afac3afc7fa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.162292 Oct 13 04:20:16.033482 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.network.neutron [None req-95bb6085-edef-4094-b559-b7ddca3c0a28 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] validate_networks() for [('0d1ab067-7575-4c07-97ac-3bce9cca9c59', None, None, None, None, None)] {{(pid=108260) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:20:16.035226 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 221/442] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:15 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:16.449668 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-95bb6085-edef-4094-b559-b7ddca3c0a28 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Flavor limits 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:20:16.450389 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-95bb6085-edef-4094-b559-b7ddca3c0a28 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Image limits 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:20:16.451040 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-95bb6085-edef-4094-b559-b7ddca3c0a28 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Flavor pref 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:20:16.451721 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-95bb6085-edef-4094-b559-b7ddca3c0a28 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Image pref 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:20:16.452512 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-95bb6085-edef-4094-b559-b7ddca3c0a28 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:20:16.464717 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-95bb6085-edef-4094-b559-b7ddca3c0a28 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:16.465233 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-95bb6085-edef-4094-b559-b7ddca3c0a28 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:16.466053 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-95bb6085-edef-4094-b559-b7ddca3c0a28 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:16.466675 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-95bb6085-edef-4094-b559-b7ddca3c0a28 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:16.486874 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-95bb6085-edef-4094-b559-b7ddca3c0a28 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Getting quotas for project f6806325e2e94089a6944698ad9b7808. Resources: {'ram', 'cores', 'instances'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:20:16.491249 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-95bb6085-edef-4094-b559-b7ddca3c0a28 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Getting quotas for user 9d3f110a789d432d85e185decef26aea and project f6806325e2e94089a6944698ad9b7808. Resources: {'ram', 'cores', 'instances'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:20:16.502432 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-95bb6085-edef-4094-b559-b7ddca3c0a28 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Going to run 1 instances... {{(pid=108260) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:20:16.505061 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-95bb6085-edef-4094-b559-b7ddca3c0a28 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f468f34-171a-4b6e-a0cd-2e4c6fcda23d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:20:16.562362 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-95bb6085-edef-4094-b559-b7ddca3c0a28 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595942 Oct 13 04:20:16.568579 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 222/443] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Oct 13 04:20:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 04:20:16.574764 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-395c2a3f-a2f5-48f5-8677-2b8e6cdfa6a7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:16.575705 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-395c2a3f-a2f5-48f5-8677-2b8e6cdfa6a7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:16.640699 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-395c2a3f-a2f5-48f5-8677-2b8e6cdfa6a7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:16.649065 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-395c2a3f-a2f5-48f5-8677-2b8e6cdfa6a7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 200 len: 1218 microversion: 2.1 time: 0.079445 Oct 13 04:20:16.657947 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 222/444] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:16 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:20:16.763970 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-42db2d97-a144-496d-831b-76053426c51f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:16.765732 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-42db2d97-a144-496d-831b-76053426c51f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:16.772419 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-42db2d97-a144-496d-831b-76053426c51f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:16.773117 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-42db2d97-a144-496d-831b-76053426c51f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:16.773243 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-cc4cde8d-2f35-446e-af05-6652f84605cf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:16.774260 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-cc4cde8d-2f35-446e-af05-6652f84605cf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:16.774765 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-42db2d97-a144-496d-831b-76053426c51f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:16.775378 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-42db2d97-a144-496d-831b-76053426c51f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:16.785296 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cc4cde8d-2f35-446e-af05-6652f84605cf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:16.787469 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cc4cde8d-2f35-446e-af05-6652f84605cf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:16.788348 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cc4cde8d-2f35-446e-af05-6652f84605cf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:16.788800 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cc4cde8d-2f35-446e-af05-6652f84605cf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:16.875606 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-42db2d97-a144-496d-831b-76053426c51f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.115283 Oct 13 04:20:16.876257 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 223/445] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:16 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:20:16.917101 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-cc4cde8d-2f35-446e-af05-6652f84605cf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.147838 Oct 13 04:20:16.918556 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 223/446] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:16 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:17.042198 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9813bfcf-9502-4710-9113-2dd3070279b3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:17.043403 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9813bfcf-9502-4710-9113-2dd3070279b3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:17.051264 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9813bfcf-9502-4710-9113-2dd3070279b3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:17.052041 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9813bfcf-9502-4710-9113-2dd3070279b3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:17.053087 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9813bfcf-9502-4710-9113-2dd3070279b3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:17.053538 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9813bfcf-9502-4710-9113-2dd3070279b3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:17.283601 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-9813bfcf-9502-4710-9113-2dd3070279b3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:17.310370 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9813bfcf-9502-4710-9113-2dd3070279b3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.272282 Oct 13 04:20:17.313443 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 224/447] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:17 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:17.672223 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-aa5bb785-2146-49d1-869c-02b98030599e tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:17.673209 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-aa5bb785-2146-49d1-869c-02b98030599e tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:17.683527 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aa5bb785-2146-49d1-869c-02b98030599e tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:17.684078 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aa5bb785-2146-49d1-869c-02b98030599e tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:17.685382 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aa5bb785-2146-49d1-869c-02b98030599e tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:17.685904 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aa5bb785-2146-49d1-869c-02b98030599e tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:17.796528 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-aa5bb785-2146-49d1-869c-02b98030599e tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:17.815939 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-aa5bb785-2146-49d1-869c-02b98030599e tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 200 len: 1270 microversion: 2.1 time: 0.147652 Oct 13 04:20:17.816765 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 224/448] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:17 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:17.888130 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a76dba27-312c-4bbc-8ebb-4c207ba7e051 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:17.889935 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a76dba27-312c-4bbc-8ebb-4c207ba7e051 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:17.899539 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a76dba27-312c-4bbc-8ebb-4c207ba7e051 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:17.901769 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a76dba27-312c-4bbc-8ebb-4c207ba7e051 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:17.905210 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a76dba27-312c-4bbc-8ebb-4c207ba7e051 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:17.905849 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a76dba27-312c-4bbc-8ebb-4c207ba7e051 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:17.940568 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-cd17fe9d-cff8-45c6-ade8-9d5d404f9410 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:17.941522 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-cd17fe9d-cff8-45c6-ade8-9d5d404f9410 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:17.970627 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cd17fe9d-cff8-45c6-ade8-9d5d404f9410 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:17.972581 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cd17fe9d-cff8-45c6-ade8-9d5d404f9410 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:17.973952 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cd17fe9d-cff8-45c6-ade8-9d5d404f9410 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:17.981638 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cd17fe9d-cff8-45c6-ade8-9d5d404f9410 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:18.095592 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a76dba27-312c-4bbc-8ebb-4c207ba7e051 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.212072 Oct 13 04:20:18.099495 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 225/449] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:17 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:18.129245 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-cd17fe9d-cff8-45c6-ade8-9d5d404f9410 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.200688 Oct 13 04:20:18.131936 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 225/450] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:17 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:18.330306 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ed7b5bc9-35dc-4877-a02c-ae0e2160fb18 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:18.331004 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ed7b5bc9-35dc-4877-a02c-ae0e2160fb18 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:18.359908 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ed7b5bc9-35dc-4877-a02c-ae0e2160fb18 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:18.369789 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ed7b5bc9-35dc-4877-a02c-ae0e2160fb18 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:18.371821 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ed7b5bc9-35dc-4877-a02c-ae0e2160fb18 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:18.372278 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ed7b5bc9-35dc-4877-a02c-ae0e2160fb18 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:18.582636 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-ed7b5bc9-35dc-4877-a02c-ae0e2160fb18 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:18.590577 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ed7b5bc9-35dc-4877-a02c-ae0e2160fb18 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.264801 Oct 13 04:20:18.591153 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 226/451] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:18 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:18.836300 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ba010269-799b-422e-ba2f-24696a98083f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:18.843549 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ba010269-799b-422e-ba2f-24696a98083f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:18.853858 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ba010269-799b-422e-ba2f-24696a98083f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:18.854623 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ba010269-799b-422e-ba2f-24696a98083f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:18.855703 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ba010269-799b-422e-ba2f-24696a98083f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:18.856324 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ba010269-799b-422e-ba2f-24696a98083f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:19.049943 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ba010269-799b-422e-ba2f-24696a98083f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:19.059812 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ba010269-799b-422e-ba2f-24696a98083f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 200 len: 1318 microversion: 2.1 time: 0.229483 Oct 13 04:20:19.060706 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 226/452] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:18 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:20:19.107594 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-bcd70806-665c-4012-83ec-196eacf97421 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:19.108550 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-bcd70806-665c-4012-83ec-196eacf97421 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:19.114728 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bcd70806-665c-4012-83ec-196eacf97421 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:19.115167 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bcd70806-665c-4012-83ec-196eacf97421 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:19.116187 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bcd70806-665c-4012-83ec-196eacf97421 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:19.116614 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bcd70806-665c-4012-83ec-196eacf97421 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:19.143111 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2bcee175-7c8b-4a79-8352-4f8c9a891aa5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:19.144032 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2bcee175-7c8b-4a79-8352-4f8c9a891aa5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:19.151637 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2bcee175-7c8b-4a79-8352-4f8c9a891aa5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:19.152429 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2bcee175-7c8b-4a79-8352-4f8c9a891aa5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:19.153441 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2bcee175-7c8b-4a79-8352-4f8c9a891aa5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:19.153966 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2bcee175-7c8b-4a79-8352-4f8c9a891aa5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:23.580991 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-bcd70806-665c-4012-83ec-196eacf97421 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 4.477066 Oct 13 04:20:23.582757 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 227/453] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:19 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 4480 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:23.588163 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-83304055-a6d5-4c34-81ea-bc5d2db49b9c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:23.589319 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-83304055-a6d5-4c34-81ea-bc5d2db49b9c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:23.590390 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2bcee175-7c8b-4a79-8352-4f8c9a891aa5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 4.450417 Oct 13 04:20:23.591282 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 227/454] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:19 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 4452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:23.599971 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-83304055-a6d5-4c34-81ea-bc5d2db49b9c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:23.600827 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-83304055-a6d5-4c34-81ea-bc5d2db49b9c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:23.601936 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-83304055-a6d5-4c34-81ea-bc5d2db49b9c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:23.602570 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-83304055-a6d5-4c34-81ea-bc5d2db49b9c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:23.608073 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-6dced71f-2252-41cb-98a7-49159c44ca2f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:23.608784 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-6dced71f-2252-41cb-98a7-49159c44ca2f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:23.627604 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6dced71f-2252-41cb-98a7-49159c44ca2f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:23.628385 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6dced71f-2252-41cb-98a7-49159c44ca2f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:23.629231 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6dced71f-2252-41cb-98a7-49159c44ca2f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:23.629789 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6dced71f-2252-41cb-98a7-49159c44ca2f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:23.849520 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-83304055-a6d5-4c34-81ea-bc5d2db49b9c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:23.864121 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-83304055-a6d5-4c34-81ea-bc5d2db49b9c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.279971 Oct 13 04:20:23.874020 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 228/455] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:23 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:23.879113 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-13878e1e-954d-42a6-baaa-53ce1397c0e9 req-f99e91bb-d1f3-4a6a-aec3-0d80629c5171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e3d51b-fb51-4ea1-904d-a09c4c2af595", "tag": "ce77776c-95b9-46ba-b5e4-6e4b1ad6d721"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:23.880916 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:20:23.880916 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:20:23.888466 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-13878e1e-954d-42a6-baaa-53ce1397c0e9 req-f99e91bb-d1f3-4a6a-aec3-0d80629c5171 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:23.889259 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-13878e1e-954d-42a6-baaa-53ce1397c0e9 req-f99e91bb-d1f3-4a6a-aec3-0d80629c5171 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:23.900829 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-13878e1e-954d-42a6-baaa-53ce1397c0e9 req-f99e91bb-d1f3-4a6a-aec3-0d80629c5171 service nova] Creating event network-changed:ce77776c-95b9-46ba-b5e4-6e4b1ad6d721 for instance 24e3d51b-fb51-4ea1-904d-a09c4c2af595 on hv-cinder-81275 Oct 13 04:20:23.906054 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-13878e1e-954d-42a6-baaa-53ce1397c0e9 req-f99e91bb-d1f3-4a6a-aec3-0d80629c5171 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030415 Oct 13 04:20:23.907071 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 229/456] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:20:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:20:23.910248 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-6dced71f-2252-41cb-98a7-49159c44ca2f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:23.919961 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-6dced71f-2252-41cb-98a7-49159c44ca2f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 200 len: 1318 microversion: 2.1 time: 0.327416 Oct 13 04:20:23.920734 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 228/457] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:23 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:24.594124 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3e0bbb40-a5e0-4552-8513-1f9225bd856f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:24.601312 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c7236342-3d07-466a-868a-018e6f396b69 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:24.603150 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c7236342-3d07-466a-868a-018e6f396b69 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:24.605254 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3e0bbb40-a5e0-4552-8513-1f9225bd856f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:24.615489 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7236342-3d07-466a-868a-018e6f396b69 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:24.619204 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3e0bbb40-a5e0-4552-8513-1f9225bd856f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:24.620026 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7236342-3d07-466a-868a-018e6f396b69 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:24.621150 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7236342-3d07-466a-868a-018e6f396b69 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:24.621848 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7236342-3d07-466a-868a-018e6f396b69 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:24.622564 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3e0bbb40-a5e0-4552-8513-1f9225bd856f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:24.624191 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3e0bbb40-a5e0-4552-8513-1f9225bd856f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:24.626936 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3e0bbb40-a5e0-4552-8513-1f9225bd856f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:25.171244 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3e0bbb40-a5e0-4552-8513-1f9225bd856f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.581589 Oct 13 04:20:25.173766 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 230/458] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:24 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:25.175835 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c7236342-3d07-466a-868a-018e6f396b69 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.578316 Oct 13 04:20:25.177162 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 229/459] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:24 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:25.182410 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ab8c5105-ac6a-4de6-a3da-8e1cb105a9bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:25.183067 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-36e04984-9e2b-4d12-ac61-b5c16d467b0d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:25.183494 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ab8c5105-ac6a-4de6-a3da-8e1cb105a9bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:25.183950 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-36e04984-9e2b-4d12-ac61-b5c16d467b0d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:25.190900 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ab8c5105-ac6a-4de6-a3da-8e1cb105a9bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:25.191184 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-36e04984-9e2b-4d12-ac61-b5c16d467b0d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:25.191643 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-36e04984-9e2b-4d12-ac61-b5c16d467b0d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:25.191981 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ab8c5105-ac6a-4de6-a3da-8e1cb105a9bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:25.192400 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-36e04984-9e2b-4d12-ac61-b5c16d467b0d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:25.192916 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-36e04984-9e2b-4d12-ac61-b5c16d467b0d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:25.193273 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ab8c5105-ac6a-4de6-a3da-8e1cb105a9bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:25.193880 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ab8c5105-ac6a-4de6-a3da-8e1cb105a9bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:25.417428 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-36e04984-9e2b-4d12-ac61-b5c16d467b0d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:25.418352 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ab8c5105-ac6a-4de6-a3da-8e1cb105a9bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:25.430789 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-36e04984-9e2b-4d12-ac61-b5c16d467b0d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.255693 Oct 13 04:20:25.431363 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 231/460] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:25 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:25.434247 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ab8c5105-ac6a-4de6-a3da-8e1cb105a9bd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 200 len: 1318 microversion: 2.1 time: 0.255274 Oct 13 04:20:25.434798 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 230/461] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:25 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:26.192159 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-31c1a4da-b5b1-4ca4-96d1-3dca01d6a2ed tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:26.194519 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-974fa051-bcbe-42cc-8e68-15c8348ba947 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:26.197043 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-31c1a4da-b5b1-4ca4-96d1-3dca01d6a2ed tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:26.197741 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-974fa051-bcbe-42cc-8e68-15c8348ba947 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:26.210742 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-31c1a4da-b5b1-4ca4-96d1-3dca01d6a2ed tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:26.212605 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-974fa051-bcbe-42cc-8e68-15c8348ba947 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:26.213121 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-974fa051-bcbe-42cc-8e68-15c8348ba947 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:26.214428 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-974fa051-bcbe-42cc-8e68-15c8348ba947 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:26.214700 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-31c1a4da-b5b1-4ca4-96d1-3dca01d6a2ed tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:26.215712 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-31c1a4da-b5b1-4ca4-96d1-3dca01d6a2ed tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:26.217189 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-974fa051-bcbe-42cc-8e68-15c8348ba947 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:26.217831 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-31c1a4da-b5b1-4ca4-96d1-3dca01d6a2ed tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:26.534939 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-974fa051-bcbe-42cc-8e68-15c8348ba947 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.347577 Oct 13 04:20:26.537638 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-31c1a4da-b5b1-4ca4-96d1-3dca01d6a2ed tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.353029 Oct 13 04:20:26.544143 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 231/462] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:26 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:26.546223 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 232/463] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:26 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:26.553585 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-0e017dca-1b97-40db-a4ba-d8490b6f9247 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:26.554313 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-0e017dca-1b97-40db-a4ba-d8490b6f9247 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:26.556098 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8c5db966-f83f-4a0a-b277-eeaa67da3567 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:26.557002 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-8c5db966-f83f-4a0a-b277-eeaa67da3567 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:26.565080 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8c5db966-f83f-4a0a-b277-eeaa67da3567 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:26.565930 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8c5db966-f83f-4a0a-b277-eeaa67da3567 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:26.566071 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0e017dca-1b97-40db-a4ba-d8490b6f9247 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:26.566587 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0e017dca-1b97-40db-a4ba-d8490b6f9247 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:26.567282 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8c5db966-f83f-4a0a-b277-eeaa67da3567 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:26.567396 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0e017dca-1b97-40db-a4ba-d8490b6f9247 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:26.567829 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0e017dca-1b97-40db-a4ba-d8490b6f9247 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:26.568289 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8c5db966-f83f-4a0a-b277-eeaa67da3567 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:26.762188 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-0e017dca-1b97-40db-a4ba-d8490b6f9247 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:26.771891 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-0e017dca-1b97-40db-a4ba-d8490b6f9247 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 200 len: 1318 microversion: 2.1 time: 0.223751 Oct 13 04:20:26.772589 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 233/464] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:26 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:26.778336 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-8c5db966-f83f-4a0a-b277-eeaa67da3567 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:26.788344 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-8c5db966-f83f-4a0a-b277-eeaa67da3567 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.244653 Oct 13 04:20:26.789161 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 232/465] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:26 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:27.563718 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-56e87978-473f-40d0-8ad4-6fd5a08bb202 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:27.564705 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-56e87978-473f-40d0-8ad4-6fd5a08bb202 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:27.568525 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-05811e27-f5b2-4807-9825-7fad5cc6d2fe tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:27.570862 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-05811e27-f5b2-4807-9825-7fad5cc6d2fe tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:27.584252 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-56e87978-473f-40d0-8ad4-6fd5a08bb202 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:27.584699 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-56e87978-473f-40d0-8ad4-6fd5a08bb202 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:27.588177 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-05811e27-f5b2-4807-9825-7fad5cc6d2fe tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:27.589885 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-56e87978-473f-40d0-8ad4-6fd5a08bb202 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:27.590494 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-56e87978-473f-40d0-8ad4-6fd5a08bb202 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:27.591129 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-05811e27-f5b2-4807-9825-7fad5cc6d2fe tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:27.596020 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-05811e27-f5b2-4807-9825-7fad5cc6d2fe tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:27.596457 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-05811e27-f5b2-4807-9825-7fad5cc6d2fe tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:27.687318 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-05811e27-f5b2-4807-9825-7fad5cc6d2fe tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.138879 Oct 13 04:20:27.691669 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 234/466] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:27 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:27.696348 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-56e87978-473f-40d0-8ad4-6fd5a08bb202 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.148498 Oct 13 04:20:27.697370 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 233/467] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:27 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:27.791174 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c6fc7a46-e607-4e8a-b074-d81e7afae04a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:27.791952 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c6fc7a46-e607-4e8a-b074-d81e7afae04a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:27.801884 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c6fc7a46-e607-4e8a-b074-d81e7afae04a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:27.802488 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c6fc7a46-e607-4e8a-b074-d81e7afae04a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:27.803853 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c6fc7a46-e607-4e8a-b074-d81e7afae04a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:27.804409 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c6fc7a46-e607-4e8a-b074-d81e7afae04a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:27.808567 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d1bb8f75-84de-4183-bf58-28612857e5f1 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:27.809478 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d1bb8f75-84de-4183-bf58-28612857e5f1 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:27.818300 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d1bb8f75-84de-4183-bf58-28612857e5f1 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:27.819056 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d1bb8f75-84de-4183-bf58-28612857e5f1 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:27.821095 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d1bb8f75-84de-4183-bf58-28612857e5f1 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:27.821999 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d1bb8f75-84de-4183-bf58-28612857e5f1 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:28.043720 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-c6fc7a46-e607-4e8a-b074-d81e7afae04a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:28.053541 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c6fc7a46-e607-4e8a-b074-d81e7afae04a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 200 len: 1318 microversion: 2.1 time: 0.267432 Oct 13 04:20:28.063177 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-d1bb8f75-84de-4183-bf58-28612857e5f1 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:28.063825 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 235/468] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:27 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:28.071505 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d1bb8f75-84de-4183-bf58-28612857e5f1 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.266877 Oct 13 04:20:28.072544 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 234/469] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:27 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:28.699181 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c70a4b91-8ab4-4ee4-a469-ae32c4a705e1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:28.700544 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c70a4b91-8ab4-4ee4-a469-ae32c4a705e1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:28.707277 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c70a4b91-8ab4-4ee4-a469-ae32c4a705e1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:28.707779 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c70a4b91-8ab4-4ee4-a469-ae32c4a705e1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:28.708537 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c70a4b91-8ab4-4ee4-a469-ae32c4a705e1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:28.708684 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-9d2ef3bc-0a11-496a-a3e4-98c18e164b23 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:28.709587 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-9d2ef3bc-0a11-496a-a3e4-98c18e164b23 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:28.709988 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c70a4b91-8ab4-4ee4-a469-ae32c4a705e1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:28.717081 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9d2ef3bc-0a11-496a-a3e4-98c18e164b23 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:28.717580 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9d2ef3bc-0a11-496a-a3e4-98c18e164b23 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:28.718699 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9d2ef3bc-0a11-496a-a3e4-98c18e164b23 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:28.719308 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9d2ef3bc-0a11-496a-a3e4-98c18e164b23 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:28.815971 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c70a4b91-8ab4-4ee4-a469-ae32c4a705e1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.120055 Oct 13 04:20:28.816912 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 236/470] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:28 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:28.907738 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-9d2ef3bc-0a11-496a-a3e4-98c18e164b23 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.202744 Oct 13 04:20:28.908497 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 235/471] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:28 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:29.071127 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a33c0285-faa1-41b0-9027-f89d4a73bcc0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:29.071721 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a33c0285-faa1-41b0-9027-f89d4a73bcc0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:29.079724 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a33c0285-faa1-41b0-9027-f89d4a73bcc0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:29.080410 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a33c0285-faa1-41b0-9027-f89d4a73bcc0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:29.081427 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a33c0285-faa1-41b0-9027-f89d4a73bcc0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:29.081888 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a33c0285-faa1-41b0-9027-f89d4a73bcc0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:29.088834 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4b9e7cd9-d314-4588-8115-701fd73acdab tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:29.089778 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4b9e7cd9-d314-4588-8115-701fd73acdab tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:29.096432 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4b9e7cd9-d314-4588-8115-701fd73acdab tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:29.096998 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4b9e7cd9-d314-4588-8115-701fd73acdab tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:29.097990 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4b9e7cd9-d314-4588-8115-701fd73acdab tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:29.098447 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4b9e7cd9-d314-4588-8115-701fd73acdab tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:29.497940 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a33c0285-faa1-41b0-9027-f89d4a73bcc0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:29.507346 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a33c0285-faa1-41b0-9027-f89d4a73bcc0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 200 len: 1318 microversion: 2.1 time: 0.440407 Oct 13 04:20:29.508046 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-4b9e7cd9-d314-4588-8115-701fd73acdab tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:29.518315 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 237/472] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:29 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:29.526909 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4b9e7cd9-d314-4588-8115-701fd73acdab tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.442113 Oct 13 04:20:29.534645 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 236/473] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:29 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:20:29.829207 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ea31bd45-6e78-4f4a-8d27-b67a64e9c43c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:29.833959 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ea31bd45-6e78-4f4a-8d27-b67a64e9c43c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:29.841687 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ea31bd45-6e78-4f4a-8d27-b67a64e9c43c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:29.842383 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ea31bd45-6e78-4f4a-8d27-b67a64e9c43c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:29.845178 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ea31bd45-6e78-4f4a-8d27-b67a64e9c43c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:29.845850 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ea31bd45-6e78-4f4a-8d27-b67a64e9c43c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:29.921879 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b42359a2-7790-4a48-a31c-46df50ee5f5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:29.922948 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b42359a2-7790-4a48-a31c-46df50ee5f5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:29.929235 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b42359a2-7790-4a48-a31c-46df50ee5f5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:29.929692 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b42359a2-7790-4a48-a31c-46df50ee5f5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:29.930487 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b42359a2-7790-4a48-a31c-46df50ee5f5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:29.930908 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b42359a2-7790-4a48-a31c-46df50ee5f5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:29.946647 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ea31bd45-6e78-4f4a-8d27-b67a64e9c43c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.121732 Oct 13 04:20:29.951761 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 238/474] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:29 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:30.226233 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b42359a2-7790-4a48-a31c-46df50ee5f5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.309130 Oct 13 04:20:30.230496 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 237/475] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:29 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:30.528319 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6e5b89c9-34b3-4c2b-b43f-58cd84a820da tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:30.529792 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6e5b89c9-34b3-4c2b-b43f-58cd84a820da tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:30.539676 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6e5b89c9-34b3-4c2b-b43f-58cd84a820da tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:30.540258 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6e5b89c9-34b3-4c2b-b43f-58cd84a820da tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:30.541144 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6e5b89c9-34b3-4c2b-b43f-58cd84a820da tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:30.541792 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6e5b89c9-34b3-4c2b-b43f-58cd84a820da tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:30.550838 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f3d334f4-7cb8-4679-875b-754b8eb0b5c3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:30.551568 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f3d334f4-7cb8-4679-875b-754b8eb0b5c3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:30.565657 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3d334f4-7cb8-4679-875b-754b8eb0b5c3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:30.566121 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3d334f4-7cb8-4679-875b-754b8eb0b5c3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:30.566936 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3d334f4-7cb8-4679-875b-754b8eb0b5c3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:30.567365 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3d334f4-7cb8-4679-875b-754b8eb0b5c3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:30.764496 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6e5b89c9-34b3-4c2b-b43f-58cd84a820da tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:30.779865 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6e5b89c9-34b3-4c2b-b43f-58cd84a820da tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 200 len: 1318 microversion: 2.1 time: 0.258076 Oct 13 04:20:30.789776 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 239/476] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:30 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:30.794600 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f3d334f4-7cb8-4679-875b-754b8eb0b5c3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:30.804751 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f3d334f4-7cb8-4679-875b-754b8eb0b5c3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.263193 Oct 13 04:20:30.817126 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 238/477] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:30 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:20:30.959250 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-475d4233-6261-4b04-ba18-1988a4edcd1b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:30.960813 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-475d4233-6261-4b04-ba18-1988a4edcd1b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:30.967123 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-475d4233-6261-4b04-ba18-1988a4edcd1b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:30.967794 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-475d4233-6261-4b04-ba18-1988a4edcd1b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:30.968726 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-475d4233-6261-4b04-ba18-1988a4edcd1b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:30.969366 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-475d4233-6261-4b04-ba18-1988a4edcd1b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:31.050027 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-475d4233-6261-4b04-ba18-1988a4edcd1b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.094294 Oct 13 04:20:31.050680 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 240/478] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:30 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:31.238151 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b7d08080-16da-4166-9e9a-fde4cb1e3ef7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:31.239074 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b7d08080-16da-4166-9e9a-fde4cb1e3ef7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:31.245339 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b7d08080-16da-4166-9e9a-fde4cb1e3ef7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:31.245747 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b7d08080-16da-4166-9e9a-fde4cb1e3ef7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:31.246560 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b7d08080-16da-4166-9e9a-fde4cb1e3ef7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:31.247141 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b7d08080-16da-4166-9e9a-fde4cb1e3ef7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:31.410022 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b7d08080-16da-4166-9e9a-fde4cb1e3ef7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.175264 Oct 13 04:20:31.410778 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 239/479] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:31 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:31.806636 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-828fdca8-0c41-4f03-b112-a1e491d6dce4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:31.807764 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-828fdca8-0c41-4f03-b112-a1e491d6dce4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:31.814358 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-828fdca8-0c41-4f03-b112-a1e491d6dce4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:31.815287 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-828fdca8-0c41-4f03-b112-a1e491d6dce4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:31.816308 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-828fdca8-0c41-4f03-b112-a1e491d6dce4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:31.817085 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-828fdca8-0c41-4f03-b112-a1e491d6dce4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:31.830058 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-936f4dc3-96c5-4825-b722-a0206df21fd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:31.830772 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-936f4dc3-96c5-4825-b722-a0206df21fd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:31.846833 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-936f4dc3-96c5-4825-b722-a0206df21fd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:31.847550 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-936f4dc3-96c5-4825-b722-a0206df21fd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:31.848614 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-936f4dc3-96c5-4825-b722-a0206df21fd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:31.849253 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-936f4dc3-96c5-4825-b722-a0206df21fd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:32.099518 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-828fdca8-0c41-4f03-b112-a1e491d6dce4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:32.107164 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-936f4dc3-96c5-4825-b722-a0206df21fd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:32.109112 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-828fdca8-0c41-4f03-b112-a1e491d6dce4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 200 len: 1318 microversion: 2.1 time: 0.314420 Oct 13 04:20:32.118507 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 241/480] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:31 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:32.120834 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-936f4dc3-96c5-4825-b722-a0206df21fd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.291150 Oct 13 04:20:32.124119 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-8a3af98c-bd2b-45de-884e-dbdb55b85ad0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:32.127916 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 240/481] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:31 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:32.134152 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-8a3af98c-bd2b-45de-884e-dbdb55b85ad0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:32.144904 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8a3af98c-bd2b-45de-884e-dbdb55b85ad0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:32.145339 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8a3af98c-bd2b-45de-884e-dbdb55b85ad0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:32.146156 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8a3af98c-bd2b-45de-884e-dbdb55b85ad0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:32.146741 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8a3af98c-bd2b-45de-884e-dbdb55b85ad0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:32.181528 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-9bbea705-ffb9-4c10-95fb-cac819637b52 req-fd1cbf30-e0f0-409d-ba29-dcd8d98af384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e3d51b-fb51-4ea1-904d-a09c4c2af595", "name": "network-vif-plugged", "status": "completed", "tag": "ce77776c-95b9-46ba-b5e4-6e4b1ad6d721"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:32.183223 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:20:32.183223 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:20:32.192578 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-9bbea705-ffb9-4c10-95fb-cac819637b52 req-fd1cbf30-e0f0-409d-ba29-dcd8d98af384 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:32.193014 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-9bbea705-ffb9-4c10-95fb-cac819637b52 req-fd1cbf30-e0f0-409d-ba29-dcd8d98af384 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:32.204207 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-9bbea705-ffb9-4c10-95fb-cac819637b52 req-fd1cbf30-e0f0-409d-ba29-dcd8d98af384 service nova] Creating event network-vif-plugged:ce77776c-95b9-46ba-b5e4-6e4b1ad6d721 for instance 24e3d51b-fb51-4ea1-904d-a09c4c2af595 on hv-cinder-81275 Oct 13 04:20:32.209721 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-9bbea705-ffb9-4c10-95fb-cac819637b52 req-fd1cbf30-e0f0-409d-ba29-dcd8d98af384 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032258 Oct 13 04:20:32.210363 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 241/482] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:20:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:20:32.423009 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e6a84081-52a9-4786-8408-d74bb24a929e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:32.424166 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e6a84081-52a9-4786-8408-d74bb24a929e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:32.430150 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e6a84081-52a9-4786-8408-d74bb24a929e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:32.430591 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e6a84081-52a9-4786-8408-d74bb24a929e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:32.431346 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e6a84081-52a9-4786-8408-d74bb24a929e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:32.431767 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e6a84081-52a9-4786-8408-d74bb24a929e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:32.660108 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e6a84081-52a9-4786-8408-d74bb24a929e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.240959 Oct 13 04:20:32.664544 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 242/483] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:32 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:32.706984 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-8a3af98c-bd2b-45de-884e-dbdb55b85ad0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.586586 Oct 13 04:20:32.712426 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 242/484] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:32 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:33.127202 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f3e8a809-0e7e-4e04-a590-e4f19b1d5827 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:33.127955 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f3e8a809-0e7e-4e04-a590-e4f19b1d5827 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:33.134698 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3e8a809-0e7e-4e04-a590-e4f19b1d5827 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:33.135330 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3e8a809-0e7e-4e04-a590-e4f19b1d5827 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:33.136263 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3e8a809-0e7e-4e04-a590-e4f19b1d5827 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:33.136839 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3e8a809-0e7e-4e04-a590-e4f19b1d5827 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:33.138640 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d07903f0-a7f9-496e-80b1-9cc45f06dce0 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:33.139245 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d07903f0-a7f9-496e-80b1-9cc45f06dce0 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:33.148636 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d07903f0-a7f9-496e-80b1-9cc45f06dce0 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:33.149075 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d07903f0-a7f9-496e-80b1-9cc45f06dce0 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:33.149866 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d07903f0-a7f9-496e-80b1-9cc45f06dce0 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:33.150287 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d07903f0-a7f9-496e-80b1-9cc45f06dce0 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:33.464626 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f3e8a809-0e7e-4e04-a590-e4f19b1d5827 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:33.472444 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f3e8a809-0e7e-4e04-a590-e4f19b1d5827 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 200 len: 1318 microversion: 2.1 time: 0.349572 Oct 13 04:20:33.473007 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 243/485] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:33 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:33.489653 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d07903f0-a7f9-496e-80b1-9cc45f06dce0 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:33.497029 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d07903f0-a7f9-496e-80b1-9cc45f06dce0 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1520 microversion: 2.1 time: 0.362554 Oct 13 04:20:33.497860 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 243/486] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:33 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1520 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:33.673005 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-086bb63c-bd21-4cca-9bd9-76e5284a2130 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:33.674313 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-086bb63c-bd21-4cca-9bd9-76e5284a2130 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:33.680439 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-086bb63c-bd21-4cca-9bd9-76e5284a2130 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:33.681065 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-086bb63c-bd21-4cca-9bd9-76e5284a2130 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:33.682242 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-086bb63c-bd21-4cca-9bd9-76e5284a2130 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:33.684156 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-086bb63c-bd21-4cca-9bd9-76e5284a2130 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:33.720485 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b64fa047-c58b-42e9-ab24-5cebad8f0970 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:33.721591 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b64fa047-c58b-42e9-ab24-5cebad8f0970 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:33.727306 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b64fa047-c58b-42e9-ab24-5cebad8f0970 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:33.727794 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b64fa047-c58b-42e9-ab24-5cebad8f0970 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:33.728731 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b64fa047-c58b-42e9-ab24-5cebad8f0970 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:33.729151 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b64fa047-c58b-42e9-ab24-5cebad8f0970 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:33.982531 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b64fa047-c58b-42e9-ab24-5cebad8f0970 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.266215 Oct 13 04:20:33.987136 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-086bb63c-bd21-4cca-9bd9-76e5284a2130 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.304461 Oct 13 04:20:33.987750 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 244/487] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:33 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:33.988236 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 244/488] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:33 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:20:34.491007 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0182d73c-37d5-468d-9ac4-91d0051973a3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:34.491692 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0182d73c-37d5-468d-9ac4-91d0051973a3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:34.498747 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0182d73c-37d5-468d-9ac4-91d0051973a3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:34.499287 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0182d73c-37d5-468d-9ac4-91d0051973a3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:34.500084 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0182d73c-37d5-468d-9ac4-91d0051973a3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:34.500515 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0182d73c-37d5-468d-9ac4-91d0051973a3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:34.514705 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-cda95dd6-7553-405b-a18d-5ebd49d8dae9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:34.515370 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-cda95dd6-7553-405b-a18d-5ebd49d8dae9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:34.522608 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cda95dd6-7553-405b-a18d-5ebd49d8dae9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:34.523064 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cda95dd6-7553-405b-a18d-5ebd49d8dae9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:34.523819 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cda95dd6-7553-405b-a18d-5ebd49d8dae9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:34.524230 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cda95dd6-7553-405b-a18d-5ebd49d8dae9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:35.064271 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-0182d73c-37d5-468d-9ac4-91d0051973a3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:35.067805 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-cda95dd6-7553-405b-a18d-5ebd49d8dae9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:35.078976 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-cda95dd6-7553-405b-a18d-5ebd49d8dae9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1500 microversion: 2.1 time: 0.568226 Oct 13 04:20:35.079580 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 245/489] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:34 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1500 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:35.083589 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0182d73c-37d5-468d-9ac4-91d0051973a3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 200 len: 1318 microversion: 2.1 time: 0.596852 Oct 13 04:20:35.092486 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b613e034-9e19-4488-99c3-8585025cc87f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:35.093636 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 245/490] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:34 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 1318 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:35.097491 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b613e034-9e19-4488-99c3-8585025cc87f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:35.098900 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-49eabfcb-bd24-47ff-a99a-f78aa35f28ce tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:35.099808 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-49eabfcb-bd24-47ff-a99a-f78aa35f28ce tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:35.105949 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-49eabfcb-bd24-47ff-a99a-f78aa35f28ce tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:35.106652 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-49eabfcb-bd24-47ff-a99a-f78aa35f28ce tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:35.106967 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b613e034-9e19-4488-99c3-8585025cc87f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:35.107764 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-49eabfcb-bd24-47ff-a99a-f78aa35f28ce tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:35.108334 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-49eabfcb-bd24-47ff-a99a-f78aa35f28ce tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:35.111025 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b613e034-9e19-4488-99c3-8585025cc87f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:35.111849 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b613e034-9e19-4488-99c3-8585025cc87f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:35.112288 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b613e034-9e19-4488-99c3-8585025cc87f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:35.197304 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b613e034-9e19-4488-99c3-8585025cc87f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.112844 Oct 13 04:20:35.198209 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 246/491] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:35 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:35.211221 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-86bc0ac0-4218-4f2f-97d3-dd47be8899c2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:35.212599 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-86bc0ac0-4218-4f2f-97d3-dd47be8899c2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:35.218816 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-49eabfcb-bd24-47ff-a99a-f78aa35f28ce tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.123295 Oct 13 04:20:35.219113 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 246/492] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:35 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:35.223126 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-86bc0ac0-4218-4f2f-97d3-dd47be8899c2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:35.223758 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-86bc0ac0-4218-4f2f-97d3-dd47be8899c2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:35.224709 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-86bc0ac0-4218-4f2f-97d3-dd47be8899c2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:35.225299 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-86bc0ac0-4218-4f2f-97d3-dd47be8899c2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:35.464016 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-86bc0ac0-4218-4f2f-97d3-dd47be8899c2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:35.479463 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-86bc0ac0-4218-4f2f-97d3-dd47be8899c2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1514 microversion: 2.1 time: 0.274195 Oct 13 04:20:35.481405 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 247/493] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:35 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1514 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:36.107221 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b40ca776-3f82-4976-a975-126c975e4123 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:36.108808 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b40ca776-3f82-4976-a975-126c975e4123 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:36.114951 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b40ca776-3f82-4976-a975-126c975e4123 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:36.115561 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b40ca776-3f82-4976-a975-126c975e4123 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:36.116506 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b40ca776-3f82-4976-a975-126c975e4123 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:36.117091 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b40ca776-3f82-4976-a975-126c975e4123 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:36.209096 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-bc9b9d34-994b-4342-bc2f-8797c725e52b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:36.210675 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-bc9b9d34-994b-4342-bc2f-8797c725e52b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:36.216844 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bc9b9d34-994b-4342-bc2f-8797c725e52b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:36.217286 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bc9b9d34-994b-4342-bc2f-8797c725e52b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:36.218278 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bc9b9d34-994b-4342-bc2f-8797c725e52b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:36.218867 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bc9b9d34-994b-4342-bc2f-8797c725e52b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:36.308996 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-bc9b9d34-994b-4342-bc2f-8797c725e52b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.103433 Oct 13 04:20:36.309681 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 248/494] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:36 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:36.318724 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b2ebaa10-66c7-4169-bbcc-5967c2cbf44f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:36.319908 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b2ebaa10-66c7-4169-bbcc-5967c2cbf44f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:36.327678 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b2ebaa10-66c7-4169-bbcc-5967c2cbf44f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:36.328459 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b2ebaa10-66c7-4169-bbcc-5967c2cbf44f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:36.329381 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b2ebaa10-66c7-4169-bbcc-5967c2cbf44f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:36.329995 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b2ebaa10-66c7-4169-bbcc-5967c2cbf44f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:36.345913 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b40ca776-3f82-4976-a975-126c975e4123 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:36.357325 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b40ca776-3f82-4976-a975-126c975e4123 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 200 len: 1509 microversion: 2.1 time: 0.254678 Oct 13 04:20:36.372868 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 247/495] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:36 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 1509 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:36.395569 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b2ebaa10-66c7-4169-bbcc-5967c2cbf44f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.080546 Oct 13 04:20:36.396539 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 249/496] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:36 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:37.320371 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-90ab722a-8d24-474a-b608-5a66e6fc22dd tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:37.322002 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-90ab722a-8d24-474a-b608-5a66e6fc22dd tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:37.328702 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-90ab722a-8d24-474a-b608-5a66e6fc22dd tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:37.329251 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-90ab722a-8d24-474a-b608-5a66e6fc22dd tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:37.330207 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-90ab722a-8d24-474a-b608-5a66e6fc22dd tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:37.330706 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-90ab722a-8d24-474a-b608-5a66e6fc22dd tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:37.405995 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-90ab722a-8d24-474a-b608-5a66e6fc22dd tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.089037 Oct 13 04:20:37.407027 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 248/497] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:37 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:37.408415 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-cec1a19b-005b-4b66-a650-7514ac62a1e8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:37.409449 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-cec1a19b-005b-4b66-a650-7514ac62a1e8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:37.416340 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cec1a19b-005b-4b66-a650-7514ac62a1e8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:37.417024 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cec1a19b-005b-4b66-a650-7514ac62a1e8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:37.417985 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cec1a19b-005b-4b66-a650-7514ac62a1e8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:37.418639 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cec1a19b-005b-4b66-a650-7514ac62a1e8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:37.491962 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-cec1a19b-005b-4b66-a650-7514ac62a1e8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.087624 Oct 13 04:20:37.492619 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 250/498] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:37 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:38.071060 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1e248f1a-c52d-4f0c-9d4c-d2ddb2cce5b7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:38.072234 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1e248f1a-c52d-4f0c-9d4c-d2ddb2cce5b7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:38.079644 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1e248f1a-c52d-4f0c-9d4c-d2ddb2cce5b7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:38.080169 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1e248f1a-c52d-4f0c-9d4c-d2ddb2cce5b7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:38.080997 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1e248f1a-c52d-4f0c-9d4c-d2ddb2cce5b7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:38.081483 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1e248f1a-c52d-4f0c-9d4c-d2ddb2cce5b7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:38.104406 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-1e248f1a-c52d-4f0c-9d4c-d2ddb2cce5b7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lazy-loading 'flavor' on Instance uuid 2b4223c8-bfe1-440e-89bc-7158a1490e1c {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:20:38.180804 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1e248f1a-c52d-4f0c-9d4c-d2ddb2cce5b7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "POST /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/action" status: 200 len: 32 microversion: 2.1 time: 0.114084 Oct 13 04:20:38.182197 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 249/499] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:38 2021] POST /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/action => generated 32 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:20:38.193821 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-261fbc68-bf21-4d6a-b91e-f9325d868ffe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:38.194780 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-261fbc68-bf21-4d6a-b91e-f9325d868ffe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:38.202210 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-261fbc68-bf21-4d6a-b91e-f9325d868ffe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:38.203939 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-261fbc68-bf21-4d6a-b91e-f9325d868ffe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:38.204936 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-261fbc68-bf21-4d6a-b91e-f9325d868ffe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:38.205459 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-261fbc68-bf21-4d6a-b91e-f9325d868ffe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:38.418412 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-660715d7-89d6-4469-93ad-a28cfdfe27e1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:38.420123 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-660715d7-89d6-4469-93ad-a28cfdfe27e1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:38.438726 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-660715d7-89d6-4469-93ad-a28cfdfe27e1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:38.439406 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-660715d7-89d6-4469-93ad-a28cfdfe27e1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:38.440516 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-660715d7-89d6-4469-93ad-a28cfdfe27e1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:38.441026 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-660715d7-89d6-4469-93ad-a28cfdfe27e1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:38.475369 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-261fbc68-bf21-4d6a-b91e-f9325d868ffe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:38.488333 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-261fbc68-bf21-4d6a-b91e-f9325d868ffe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.300377 Oct 13 04:20:38.491059 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 251/500] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:38 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:38.505037 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f66ead04-1add-47ca-85a6-e3144bf32832 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:38.506057 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f66ead04-1add-47ca-85a6-e3144bf32832 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:38.517911 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f66ead04-1add-47ca-85a6-e3144bf32832 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:38.518400 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f66ead04-1add-47ca-85a6-e3144bf32832 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:38.519627 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f66ead04-1add-47ca-85a6-e3144bf32832 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:38.520108 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f66ead04-1add-47ca-85a6-e3144bf32832 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:38.524480 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-660715d7-89d6-4469-93ad-a28cfdfe27e1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.109905 Oct 13 04:20:38.527397 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 250/501] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:38 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:20:38.593459 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f66ead04-1add-47ca-85a6-e3144bf32832 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.092818 Oct 13 04:20:38.595580 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 252/502] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:38 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:38.866117 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f678440b-29c7-4d3f-8410-88fa4d7d12d4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91fa3512-d04e-4eb2-875e-96cda0fdb52b"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:38.867576 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f678440b-29c7-4d3f-8410-88fa4d7d12d4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:38.875330 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f678440b-29c7-4d3f-8410-88fa4d7d12d4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:38.876048 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f678440b-29c7-4d3f-8410-88fa4d7d12d4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:38.876988 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f678440b-29c7-4d3f-8410-88fa4d7d12d4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:38.877713 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f678440b-29c7-4d3f-8410-88fa4d7d12d4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:39.224624 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f678440b-29c7-4d3f-8410-88fa4d7d12d4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "POST /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362611 Oct 13 04:20:39.235649 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 251/503] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Oct 13 04:20:38 2021] POST /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:20:39.508550 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-55df28f0-af6d-4b33-bd4d-0a041115cc27 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:39.510211 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-55df28f0-af6d-4b33-bd4d-0a041115cc27 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:39.518020 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-55df28f0-af6d-4b33-bd4d-0a041115cc27 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:39.518849 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-55df28f0-af6d-4b33-bd4d-0a041115cc27 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:39.520445 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-55df28f0-af6d-4b33-bd4d-0a041115cc27 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:39.521129 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-55df28f0-af6d-4b33-bd4d-0a041115cc27 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:39.548642 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7efa0261-81a3-4080-b4f9-52fdb55f4c74 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:39.551257 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7efa0261-81a3-4080-b4f9-52fdb55f4c74 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:39.570228 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7efa0261-81a3-4080-b4f9-52fdb55f4c74 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:39.570228 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7efa0261-81a3-4080-b4f9-52fdb55f4c74 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:39.570228 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7efa0261-81a3-4080-b4f9-52fdb55f4c74 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:39.570228 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7efa0261-81a3-4080-b4f9-52fdb55f4c74 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:39.659168 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7efa0261-81a3-4080-b4f9-52fdb55f4c74 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.123324 Oct 13 04:20:39.660510 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 252/504] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:39 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:39.668769 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0e182c08-5e69-45d0-9456-7f98378ab264 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:39.672170 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0e182c08-5e69-45d0-9456-7f98378ab264 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:39.682600 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0e182c08-5e69-45d0-9456-7f98378ab264 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:39.683304 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0e182c08-5e69-45d0-9456-7f98378ab264 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:39.685147 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0e182c08-5e69-45d0-9456-7f98378ab264 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:39.686037 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0e182c08-5e69-45d0-9456-7f98378ab264 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:39.753206 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-55df28f0-af6d-4b33-bd4d-0a041115cc27 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:39.763711 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-55df28f0-af6d-4b33-bd4d-0a041115cc27 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.259884 Oct 13 04:20:39.764879 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 253/505] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:39 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:39.786076 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0e182c08-5e69-45d0-9456-7f98378ab264 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.122393 Oct 13 04:20:39.788239 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 253/506] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:39 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:40.672353 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-984b914d-fbb7-4963-a872-06506be80541 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:40.673286 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-984b914d-fbb7-4963-a872-06506be80541 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:40.680545 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-984b914d-fbb7-4963-a872-06506be80541 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:40.681179 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-984b914d-fbb7-4963-a872-06506be80541 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:40.682225 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-984b914d-fbb7-4963-a872-06506be80541 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:40.682805 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-984b914d-fbb7-4963-a872-06506be80541 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:40.781025 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-27271d59-f6ac-4a2e-8948-3a62dfe9467a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:40.781951 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-27271d59-f6ac-4a2e-8948-3a62dfe9467a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:40.790883 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-27271d59-f6ac-4a2e-8948-3a62dfe9467a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:40.795272 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-27271d59-f6ac-4a2e-8948-3a62dfe9467a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:40.797877 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-984b914d-fbb7-4963-a872-06506be80541 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.129148 Oct 13 04:20:40.798528 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 254/507] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:40 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:40.798881 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-27271d59-f6ac-4a2e-8948-3a62dfe9467a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:40.799409 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-27271d59-f6ac-4a2e-8948-3a62dfe9467a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:40.803508 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b0893e4b-9080-4a54-bf83-42ccb6b2ea87 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:40.804500 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b0893e4b-9080-4a54-bf83-42ccb6b2ea87 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:40.830273 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0893e4b-9080-4a54-bf83-42ccb6b2ea87 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:40.830480 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0893e4b-9080-4a54-bf83-42ccb6b2ea87 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:40.831516 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0893e4b-9080-4a54-bf83-42ccb6b2ea87 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:40.833110 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0893e4b-9080-4a54-bf83-42ccb6b2ea87 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:40.953171 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b0893e4b-9080-4a54-bf83-42ccb6b2ea87 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.153167 Oct 13 04:20:40.953868 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 255/508] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:40 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:41.254215 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-27271d59-f6ac-4a2e-8948-3a62dfe9467a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:41.264180 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-27271d59-f6ac-4a2e-8948-3a62dfe9467a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.487301 Oct 13 04:20:41.266447 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 254/509] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:40 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:41.815993 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a9d57267-4579-4c43-af1c-62a3ec2c35b6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:41.817197 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a9d57267-4579-4c43-af1c-62a3ec2c35b6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:41.824381 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a9d57267-4579-4c43-af1c-62a3ec2c35b6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:41.830468 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a9d57267-4579-4c43-af1c-62a3ec2c35b6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:41.831221 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a9d57267-4579-4c43-af1c-62a3ec2c35b6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:41.831653 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a9d57267-4579-4c43-af1c-62a3ec2c35b6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:41.916538 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a9d57267-4579-4c43-af1c-62a3ec2c35b6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.109796 Oct 13 04:20:41.921010 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 256/510] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:41 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:41.964465 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-146e44ff-f7ff-4aee-8aa9-0ad5eaffbb96 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:41.966736 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-146e44ff-f7ff-4aee-8aa9-0ad5eaffbb96 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:41.977437 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-146e44ff-f7ff-4aee-8aa9-0ad5eaffbb96 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:41.979347 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-146e44ff-f7ff-4aee-8aa9-0ad5eaffbb96 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:41.981086 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-146e44ff-f7ff-4aee-8aa9-0ad5eaffbb96 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:41.981755 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-146e44ff-f7ff-4aee-8aa9-0ad5eaffbb96 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:42.104261 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-146e44ff-f7ff-4aee-8aa9-0ad5eaffbb96 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.143143 Oct 13 04:20:42.105639 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 255/511] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:41 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:20:42.282624 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2c54eab2-41b4-4498-8339-7d8930c65486 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:42.283516 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-2c54eab2-41b4-4498-8339-7d8930c65486 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:42.299543 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2c54eab2-41b4-4498-8339-7d8930c65486 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:42.300294 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2c54eab2-41b4-4498-8339-7d8930c65486 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:42.304694 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2c54eab2-41b4-4498-8339-7d8930c65486 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:42.305348 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2c54eab2-41b4-4498-8339-7d8930c65486 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:42.701552 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-2c54eab2-41b4-4498-8339-7d8930c65486 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:42.711637 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-2c54eab2-41b4-4498-8339-7d8930c65486 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.432774 Oct 13 04:20:42.712784 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 257/512] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:42 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:42.929800 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b4c0f4d9-237d-4003-b1ae-ea28db1be4a1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:42.931144 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b4c0f4d9-237d-4003-b1ae-ea28db1be4a1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:42.939084 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b4c0f4d9-237d-4003-b1ae-ea28db1be4a1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:42.939757 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b4c0f4d9-237d-4003-b1ae-ea28db1be4a1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:42.940918 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b4c0f4d9-237d-4003-b1ae-ea28db1be4a1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:42.941595 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b4c0f4d9-237d-4003-b1ae-ea28db1be4a1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:43.030683 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b4c0f4d9-237d-4003-b1ae-ea28db1be4a1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.105425 Oct 13 04:20:43.031741 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 256/513] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:42 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:43.122847 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-cb8ce6bf-fac9-463a-8c40-1f12f7b6d045 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:43.131285 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-cb8ce6bf-fac9-463a-8c40-1f12f7b6d045 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:43.155364 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cb8ce6bf-fac9-463a-8c40-1f12f7b6d045 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:43.156515 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cb8ce6bf-fac9-463a-8c40-1f12f7b6d045 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:43.157744 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cb8ce6bf-fac9-463a-8c40-1f12f7b6d045 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:43.158069 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cb8ce6bf-fac9-463a-8c40-1f12f7b6d045 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:43.267438 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-cb8ce6bf-fac9-463a-8c40-1f12f7b6d045 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.154567 Oct 13 04:20:43.268213 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 258/514] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:43 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:43.729443 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5c741087-5b09-47c2-a7b7-ece207753474 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:43.730266 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-5c741087-5b09-47c2-a7b7-ece207753474 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:43.742865 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5c741087-5b09-47c2-a7b7-ece207753474 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:43.744423 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5c741087-5b09-47c2-a7b7-ece207753474 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:43.745475 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5c741087-5b09-47c2-a7b7-ece207753474 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:43.746393 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5c741087-5b09-47c2-a7b7-ece207753474 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:43.909220 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-5c741087-5b09-47c2-a7b7-ece207753474 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:43.927768 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-5c741087-5b09-47c2-a7b7-ece207753474 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.202982 Oct 13 04:20:43.937656 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 257/515] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:43 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:20:44.043514 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f3b99df3-2e1c-476c-a13a-b9a96b9918a2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:44.060324 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f3b99df3-2e1c-476c-a13a-b9a96b9918a2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:44.070138 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f3b99df3-2e1c-476c-a13a-b9a96b9918a2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:44.070935 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f3b99df3-2e1c-476c-a13a-b9a96b9918a2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:44.071951 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f3b99df3-2e1c-476c-a13a-b9a96b9918a2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:44.072554 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f3b99df3-2e1c-476c-a13a-b9a96b9918a2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:44.168874 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f3b99df3-2e1c-476c-a13a-b9a96b9918a2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.129421 Oct 13 04:20:44.174324 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 259/516] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:44 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:20:44.280016 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b7f4be99-5caf-406e-8837-e25ead6ca7f5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:44.281840 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b7f4be99-5caf-406e-8837-e25ead6ca7f5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:44.288509 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b7f4be99-5caf-406e-8837-e25ead6ca7f5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:44.289340 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b7f4be99-5caf-406e-8837-e25ead6ca7f5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:44.290157 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b7f4be99-5caf-406e-8837-e25ead6ca7f5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:44.290777 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b7f4be99-5caf-406e-8837-e25ead6ca7f5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:44.355273 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b7f4be99-5caf-406e-8837-e25ead6ca7f5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.079297 Oct 13 04:20:44.356186 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 258/517] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:44 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:44.951874 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-84ddaa3b-a681-4403-9154-309eab5fb5aa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:44.952605 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-84ddaa3b-a681-4403-9154-309eab5fb5aa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:44.965458 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84ddaa3b-a681-4403-9154-309eab5fb5aa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:44.966245 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84ddaa3b-a681-4403-9154-309eab5fb5aa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:44.967017 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84ddaa3b-a681-4403-9154-309eab5fb5aa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:44.967443 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84ddaa3b-a681-4403-9154-309eab5fb5aa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:45.181832 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c73eddd5-b2c6-42ef-a2cd-1cdb50c51afc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:45.183114 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c73eddd5-b2c6-42ef-a2cd-1cdb50c51afc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:45.196695 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c73eddd5-b2c6-42ef-a2cd-1cdb50c51afc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:45.198780 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c73eddd5-b2c6-42ef-a2cd-1cdb50c51afc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:45.200545 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c73eddd5-b2c6-42ef-a2cd-1cdb50c51afc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:45.202323 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-84ddaa3b-a681-4403-9154-309eab5fb5aa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:45.203079 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c73eddd5-b2c6-42ef-a2cd-1cdb50c51afc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:45.211147 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-84ddaa3b-a681-4403-9154-309eab5fb5aa tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.262964 Oct 13 04:20:45.212653 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 260/518] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:44 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:45.371082 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c73eddd5-b2c6-42ef-a2cd-1cdb50c51afc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.193054 Oct 13 04:20:45.375951 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e66831e7-b130-4a89-9328-0e06e88e617f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:45.376259 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 259/519] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:45 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:45.377759 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e66831e7-b130-4a89-9328-0e06e88e617f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:45.388989 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e66831e7-b130-4a89-9328-0e06e88e617f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:45.390181 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e66831e7-b130-4a89-9328-0e06e88e617f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:45.391590 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e66831e7-b130-4a89-9328-0e06e88e617f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:45.393589 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e66831e7-b130-4a89-9328-0e06e88e617f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:45.521789 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e66831e7-b130-4a89-9328-0e06e88e617f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.157927 Oct 13 04:20:45.523133 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 261/520] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:45 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:20:46.230465 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-623e0ab5-fddc-4ef0-86fd-934b5a7cad5c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:46.231370 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-623e0ab5-fddc-4ef0-86fd-934b5a7cad5c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:46.238967 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-623e0ab5-fddc-4ef0-86fd-934b5a7cad5c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:46.239718 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-623e0ab5-fddc-4ef0-86fd-934b5a7cad5c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:46.240704 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-623e0ab5-fddc-4ef0-86fd-934b5a7cad5c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:46.241330 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-623e0ab5-fddc-4ef0-86fd-934b5a7cad5c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:46.387666 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-df57807b-41e9-49a2-b823-9d38143bda29 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:46.389369 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-df57807b-41e9-49a2-b823-9d38143bda29 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:46.402110 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-df57807b-41e9-49a2-b823-9d38143bda29 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:46.402870 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-df57807b-41e9-49a2-b823-9d38143bda29 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:46.404388 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-df57807b-41e9-49a2-b823-9d38143bda29 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:46.405047 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-df57807b-41e9-49a2-b823-9d38143bda29 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:46.494815 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-623e0ab5-fddc-4ef0-86fd-934b5a7cad5c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:46.513996 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-623e0ab5-fddc-4ef0-86fd-934b5a7cad5c tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.282981 Oct 13 04:20:46.516896 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 260/521] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:46 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:46.534327 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4a9eb0ba-880d-434b-a766-d5b4192c0881 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:46.540602 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4a9eb0ba-880d-434b-a766-d5b4192c0881 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:46.552544 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4a9eb0ba-880d-434b-a766-d5b4192c0881 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:46.554960 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4a9eb0ba-880d-434b-a766-d5b4192c0881 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:46.562846 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4a9eb0ba-880d-434b-a766-d5b4192c0881 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:46.563706 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4a9eb0ba-880d-434b-a766-d5b4192c0881 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:50.517661 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-df57807b-41e9-49a2-b823-9d38143bda29 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 4.134445 Oct 13 04:20:50.521991 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4a9eb0ba-880d-434b-a766-d5b4192c0881 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 3.991379 Oct 13 04:20:50.523275 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 261/522] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:46 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 3994 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:20:50.529185 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1805e78d-6cb1-4ee2-a344-1dc0ff1cac86 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:50.529775 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1805e78d-6cb1-4ee2-a344-1dc0ff1cac86 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:50.532806 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 262/523] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:46 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 4151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:50.538127 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1805e78d-6cb1-4ee2-a344-1dc0ff1cac86 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:50.538565 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1805e78d-6cb1-4ee2-a344-1dc0ff1cac86 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:50.539335 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1805e78d-6cb1-4ee2-a344-1dc0ff1cac86 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:50.539449 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3cc1bd91-a3cb-4201-843e-62f89b3a61a3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:50.539755 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1805e78d-6cb1-4ee2-a344-1dc0ff1cac86 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:50.540528 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3cc1bd91-a3cb-4201-843e-62f89b3a61a3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:50.547474 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3cc1bd91-a3cb-4201-843e-62f89b3a61a3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:50.548264 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3cc1bd91-a3cb-4201-843e-62f89b3a61a3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:50.549244 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3cc1bd91-a3cb-4201-843e-62f89b3a61a3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:50.549899 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3cc1bd91-a3cb-4201-843e-62f89b3a61a3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:50.668259 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-1805e78d-6cb1-4ee2-a344-1dc0ff1cac86 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lazy-loading 'services' on Instance uuid 24e3d51b-fb51-4ea1-904d-a09c4c2af595 {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:20:50.716662 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-3cc1bd91-a3cb-4201-843e-62f89b3a61a3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:50.725030 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3cc1bd91-a3cb-4201-843e-62f89b3a61a3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.190712 Oct 13 04:20:50.735001 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 263/524] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:50 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:50.762304 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1805e78d-6cb1-4ee2-a344-1dc0ff1cac86 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "DELETE /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595/os-volume_attachments/91fa3512-d04e-4eb2-875e-96cda0fdb52b" status: 202 len: 0 microversion: 2.1 time: 0.236583 Oct 13 04:20:50.766441 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 262/525] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Oct 13 04:20:50 2021] DELETE /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595/os-volume_attachments/91fa3512-d04e-4eb2-875e-96cda0fdb52b => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:50.773512 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ab2b6539-e008-40b8-b08b-c0b7b306b1b4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:50.774524 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ab2b6539-e008-40b8-b08b-c0b7b306b1b4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:50.789299 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ab2b6539-e008-40b8-b08b-c0b7b306b1b4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:50.789850 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ab2b6539-e008-40b8-b08b-c0b7b306b1b4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:50.793176 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ab2b6539-e008-40b8-b08b-c0b7b306b1b4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:50.793932 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ab2b6539-e008-40b8-b08b-c0b7b306b1b4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:50.833957 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ab2b6539-e008-40b8-b08b-c0b7b306b1b4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064633 Oct 13 04:20:50.834703 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 264/526] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:20:50 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:20:51.535578 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4f9b6bce-d1cd-4769-b831-b8b556e2fc33 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:51.537147 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4f9b6bce-d1cd-4769-b831-b8b556e2fc33 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:51.538646 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ea1dd3b1-60ab-478f-9bb2-9e8b457cd826 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:51.540095 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ea1dd3b1-60ab-478f-9bb2-9e8b457cd826 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:51.546460 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ea1dd3b1-60ab-478f-9bb2-9e8b457cd826 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:51.547302 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ea1dd3b1-60ab-478f-9bb2-9e8b457cd826 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:51.548259 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ea1dd3b1-60ab-478f-9bb2-9e8b457cd826 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:51.548846 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ea1dd3b1-60ab-478f-9bb2-9e8b457cd826 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:51.553357 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4f9b6bce-d1cd-4769-b831-b8b556e2fc33 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:51.553963 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4f9b6bce-d1cd-4769-b831-b8b556e2fc33 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:51.554744 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4f9b6bce-d1cd-4769-b831-b8b556e2fc33 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:51.555352 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4f9b6bce-d1cd-4769-b831-b8b556e2fc33 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:52.223153 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ea1dd3b1-60ab-478f-9bb2-9e8b457cd826 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.688694 Oct 13 04:20:52.223844 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 265/527] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:51 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:52.228416 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4f9b6bce-d1cd-4769-b831-b8b556e2fc33 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.697262 Oct 13 04:20:52.229218 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 263/528] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:51 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:52.230558 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6a3d25dd-6869-4fe7-9229-c1ba2c656b3a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:52.235561 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6a3d25dd-6869-4fe7-9229-c1ba2c656b3a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:52.239365 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-79718766-952c-47c3-a15c-f8a7de29cbe7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:52.242628 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6a3d25dd-6869-4fe7-9229-c1ba2c656b3a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:52.242858 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-79718766-952c-47c3-a15c-f8a7de29cbe7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:52.243084 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6a3d25dd-6869-4fe7-9229-c1ba2c656b3a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:52.243880 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6a3d25dd-6869-4fe7-9229-c1ba2c656b3a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:52.244315 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6a3d25dd-6869-4fe7-9229-c1ba2c656b3a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:52.255530 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-79718766-952c-47c3-a15c-f8a7de29cbe7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:52.255902 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-79718766-952c-47c3-a15c-f8a7de29cbe7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:52.256851 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-79718766-952c-47c3-a15c-f8a7de29cbe7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:52.257323 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-79718766-952c-47c3-a15c-f8a7de29cbe7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:52.294309 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-79718766-952c-47c3-a15c-f8a7de29cbe7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063214 Oct 13 04:20:52.298421 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 264/529] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:20:52 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:20:52.396596 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6a3d25dd-6869-4fe7-9229-c1ba2c656b3a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:52.423412 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6a3d25dd-6869-4fe7-9229-c1ba2c656b3a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.198325 Oct 13 04:20:52.423993 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 266/530] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:52 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:52.978843 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3c8d7193-d8ab-4ab8-bcf2-0d54790b951e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Action: 'create', calling method: .version_select at 0x7f33f6d61c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-327218553"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:52.998713 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-3c8d7193-d8ab-4ab8-bcf2-0d54790b951e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Getting quotas for project 41649d1bfdb049eeb3509c73dc1b039c. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:20:53.003062 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-3c8d7193-d8ab-4ab8-bcf2-0d54790b951e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Getting quotas for user 78ac5278aaad4f4294e2a7d971094fb2 and project 41649d1bfdb049eeb3509c73dc1b039c. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:20:53.020685 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3c8d7193-d8ab-4ab8-bcf2-0d54790b951e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [58b4f971-4ce7-4f36-be28-85cdee3dd29e] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 04:20:53.237114 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-73943e69-cd1c-4269-add2-600ec14aadb3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:53.237729 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-73943e69-cd1c-4269-add2-600ec14aadb3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:53.244132 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-73943e69-cd1c-4269-add2-600ec14aadb3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:53.244754 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-73943e69-cd1c-4269-add2-600ec14aadb3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:53.245510 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-73943e69-cd1c-4269-add2-600ec14aadb3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:53.245963 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-73943e69-cd1c-4269-add2-600ec14aadb3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:53.322903 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-73943e69-cd1c-4269-add2-600ec14aadb3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.084094 Oct 13 04:20:53.322903 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 267/531] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:53 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:53.322903 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-08a21a94-dbe6-4f4f-bca8-c667b0d7a9a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:53.322903 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-08a21a94-dbe6-4f4f-bca8-c667b0d7a9a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:53.330837 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-08a21a94-dbe6-4f4f-bca8-c667b0d7a9a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:53.331272 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-08a21a94-dbe6-4f4f-bca8-c667b0d7a9a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:53.332204 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-08a21a94-dbe6-4f4f-bca8-c667b0d7a9a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:53.332508 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-08a21a94-dbe6-4f4f-bca8-c667b0d7a9a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:53.419295 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-08a21a94-dbe6-4f4f-bca8-c667b0d7a9a6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.101306 Oct 13 04:20:53.423282 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 268/532] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:53 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:53.425502 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4e861997-ff41-4138-8d38-cf85dc813845 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:53.426916 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4e861997-ff41-4138-8d38-cf85dc813845 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:53.433998 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4e861997-ff41-4138-8d38-cf85dc813845 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:53.434523 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4e861997-ff41-4138-8d38-cf85dc813845 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:53.435548 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4e861997-ff41-4138-8d38-cf85dc813845 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:53.435990 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4e861997-ff41-4138-8d38-cf85dc813845 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:53.465602 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4e861997-ff41-4138-8d38-cf85dc813845 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044290 Oct 13 04:20:53.466182 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 269/533] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:20:53 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:20:53.470432 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-36bb0fd7-db6d-4343-ab1c-23c84f2bccdc tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:53.471002 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-36bb0fd7-db6d-4343-ab1c-23c84f2bccdc tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:53.476855 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-36bb0fd7-db6d-4343-ab1c-23c84f2bccdc tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:53.477124 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-36bb0fd7-db6d-4343-ab1c-23c84f2bccdc tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:53.477928 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-36bb0fd7-db6d-4343-ab1c-23c84f2bccdc tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:53.478354 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-36bb0fd7-db6d-4343-ab1c-23c84f2bccdc tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:53.616222 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-36bb0fd7-db6d-4343-ab1c-23c84f2bccdc tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:53.623646 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-36bb0fd7-db6d-4343-ab1c-23c84f2bccdc tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.156574 Oct 13 04:20:53.624203 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 270/534] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:53 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:54.040854 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO oslo.messaging._drivers.impl_rabbit [None req-3c8d7193-d8ab-4ab8-bcf2-0d54790b951e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [58b4f971-4ce7-4f36-be28-85cdee3dd29e] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 39646. Oct 13 04:20:54.329969 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-fa8599d6-f849-48cb-b45f-40aad9a99fc5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:54.330845 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-fa8599d6-f849-48cb-b45f-40aad9a99fc5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:54.336706 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fa8599d6-f849-48cb-b45f-40aad9a99fc5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:54.337139 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fa8599d6-f849-48cb-b45f-40aad9a99fc5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:54.337904 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fa8599d6-f849-48cb-b45f-40aad9a99fc5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:54.338355 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fa8599d6-f849-48cb-b45f-40aad9a99fc5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:54.422725 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-fa8599d6-f849-48cb-b45f-40aad9a99fc5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.097385 Oct 13 04:20:54.424038 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 271/535] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:54 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:20:54.435893 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6c749a67-40dd-4bef-acaa-2de1a4e46d91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:54.437734 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6c749a67-40dd-4bef-acaa-2de1a4e46d91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:54.448060 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6c749a67-40dd-4bef-acaa-2de1a4e46d91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:54.448704 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6c749a67-40dd-4bef-acaa-2de1a4e46d91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:54.449931 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6c749a67-40dd-4bef-acaa-2de1a4e46d91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:54.450613 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6c749a67-40dd-4bef-acaa-2de1a4e46d91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:54.558444 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6c749a67-40dd-4bef-acaa-2de1a4e46d91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.128879 Oct 13 04:20:54.563486 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 272/536] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:54 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:54.640624 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5da63ad6-e40c-4c3b-91ff-8d9fd3bc7d6d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:54.641541 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5da63ad6-e40c-4c3b-91ff-8d9fd3bc7d6d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:54.648524 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5da63ad6-e40c-4c3b-91ff-8d9fd3bc7d6d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:54.649033 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5da63ad6-e40c-4c3b-91ff-8d9fd3bc7d6d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:54.650219 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5da63ad6-e40c-4c3b-91ff-8d9fd3bc7d6d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:54.650718 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5da63ad6-e40c-4c3b-91ff-8d9fd3bc7d6d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:54.811442 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5da63ad6-e40c-4c3b-91ff-8d9fd3bc7d6d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:54.821871 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5da63ad6-e40c-4c3b-91ff-8d9fd3bc7d6d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.185236 Oct 13 04:20:54.823078 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 273/537] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:54 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:20:54.827617 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-8bec1db6-41e0-439c-862c-cd14a317bdf4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:54.828214 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-8bec1db6-41e0-439c-862c-cd14a317bdf4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:54.839891 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8bec1db6-41e0-439c-862c-cd14a317bdf4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:54.840046 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8bec1db6-41e0-439c-862c-cd14a317bdf4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:54.840853 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8bec1db6-41e0-439c-862c-cd14a317bdf4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:54.841276 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8bec1db6-41e0-439c-862c-cd14a317bdf4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:54.869363 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-8bec1db6-41e0-439c-862c-cd14a317bdf4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Going to try to terminate instance {{(pid=108260) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:20:54.956784 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-8bec1db6-41e0-439c-862c-cd14a317bdf4 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "DELETE /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 204 len: 0 microversion: 2.1 time: 0.132235 Oct 13 04:20:54.957802 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 274/538] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:20:54 2021] DELETE /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:20:54.963927 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-3c8d7193-d8ab-4ab8-bcf2-0d54790b951e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Getting quotas for project 41649d1bfdb049eeb3509c73dc1b039c. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:20:54.965774 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-da809a35-957c-4e1c-b788-41276dca12d3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:54.966861 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-da809a35-957c-4e1c-b788-41276dca12d3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:54.968594 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-3c8d7193-d8ab-4ab8-bcf2-0d54790b951e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Getting quotas for user 78ac5278aaad4f4294e2a7d971094fb2 and project 41649d1bfdb049eeb3509c73dc1b039c. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:20:54.972829 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-da809a35-957c-4e1c-b788-41276dca12d3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:54.973261 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-da809a35-957c-4e1c-b788-41276dca12d3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:54.974071 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-da809a35-957c-4e1c-b788-41276dca12d3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:54.974833 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-da809a35-957c-4e1c-b788-41276dca12d3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:54.983240 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3c8d7193-d8ab-4ab8-bcf2-0d54790b951e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 2.008046 Oct 13 04:20:54.984009 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 265/539] 10.222.0.55 () {60 vars in 1157 bytes} [Wed Oct 13 04:20:52 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 2009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:20:55.047180 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3ef8e5e4-2d41-4ef6-8fe6-15082e2ea1f7 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1175150895", "imageRef": "cc5c572b-2ca9-444a-bcec-4ba81386e4c7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-327218553", "networks": [{"uuid": "21f3e97a-4c25-41f2-9ea4-802d08f767e1"}]}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:55.112092 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-da809a35-957c-4e1c-b788-41276dca12d3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:55.114896 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.network.neutron [None req-3ef8e5e4-2d41-4ef6-8fe6-15082e2ea1f7 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] validate_networks() for [('21f3e97a-4c25-41f2-9ea4-802d08f767e1', None, None, None, None, None)] {{(pid=108259) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:20:55.119644 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-da809a35-957c-4e1c-b788-41276dca12d3 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 200 len: 1515 microversion: 2.1 time: 0.157907 Oct 13 04:20:55.120549 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 275/540] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:54 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:20:55.435594 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4425b97a-c725-430f-b999-b586cfe2d969 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:55.436489 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4425b97a-c725-430f-b999-b586cfe2d969 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:55.442821 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4425b97a-c725-430f-b999-b586cfe2d969 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:55.443259 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4425b97a-c725-430f-b999-b586cfe2d969 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:55.444027 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4425b97a-c725-430f-b999-b586cfe2d969 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:55.444453 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4425b97a-c725-430f-b999-b586cfe2d969 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:55.482093 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-3ef8e5e4-2d41-4ef6-8fe6-15082e2ea1f7 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Flavor limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:20:55.482521 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-3ef8e5e4-2d41-4ef6-8fe6-15082e2ea1f7 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Image limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:20:55.483004 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-3ef8e5e4-2d41-4ef6-8fe6-15082e2ea1f7 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Flavor pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:20:55.483400 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-3ef8e5e4-2d41-4ef6-8fe6-15082e2ea1f7 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Image pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:20:55.483800 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-3ef8e5e4-2d41-4ef6-8fe6-15082e2ea1f7 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:20:55.492919 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3ef8e5e4-2d41-4ef6-8fe6-15082e2ea1f7 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:55.493355 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3ef8e5e4-2d41-4ef6-8fe6-15082e2ea1f7 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:55.494187 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3ef8e5e4-2d41-4ef6-8fe6-15082e2ea1f7 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:55.494612 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3ef8e5e4-2d41-4ef6-8fe6-15082e2ea1f7 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:55.516037 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-3ef8e5e4-2d41-4ef6-8fe6-15082e2ea1f7 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Getting quotas for project 41649d1bfdb049eeb3509c73dc1b039c. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:20:55.520212 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-3ef8e5e4-2d41-4ef6-8fe6-15082e2ea1f7 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Getting quotas for user 78ac5278aaad4f4294e2a7d971094fb2 and project 41649d1bfdb049eeb3509c73dc1b039c. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:20:55.520414 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4425b97a-c725-430f-b999-b586cfe2d969 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.088554 Oct 13 04:20:55.521067 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 276/541] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:55 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:20:55.531277 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3ef8e5e4-2d41-4ef6-8fe6-15082e2ea1f7 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Going to run 1 instances... {{(pid=108259) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:20:55.533554 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3ef8e5e4-2d41-4ef6-8fe6-15082e2ea1f7 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc5c572b-2ca9-444a-bcec-4ba81386e4c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:20:55.571586 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1f35640b-49d7-458f-b653-a2f90ab57027 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:55.572762 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-1f35640b-49d7-458f-b653-a2f90ab57027 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:55.579664 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1f35640b-49d7-458f-b653-a2f90ab57027 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:55.580838 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1f35640b-49d7-458f-b653-a2f90ab57027 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:55.581637 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1f35640b-49d7-458f-b653-a2f90ab57027 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:55.582152 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1f35640b-49d7-458f-b653-a2f90ab57027 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:55.582333 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3ef8e5e4-2d41-4ef6-8fe6-15082e2ea1f7 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543739 Oct 13 04:20:55.583666 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 266/542] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Oct 13 04:20:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 04:20:55.592789 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0179a4dc-edae-48cc-a86e-21ca194febaa tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:55.593830 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0179a4dc-edae-48cc-a86e-21ca194febaa tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:55.648129 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-0179a4dc-edae-48cc-a86e-21ca194febaa tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:55.654650 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0179a4dc-edae-48cc-a86e-21ca194febaa tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1258 microversion: 2.1 time: 0.065685 Oct 13 04:20:55.655217 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 267/543] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:55 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:20:55.733078 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-1f35640b-49d7-458f-b653-a2f90ab57027 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.165560 Oct 13 04:20:55.733976 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 277/544] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:55 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:20:55.838818 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ad509c64-85dc-4def-808c-568767aca32e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:55.839399 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ad509c64-85dc-4def-808c-568767aca32e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:55.845495 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ad509c64-85dc-4def-808c-568767aca32e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:55.845863 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ad509c64-85dc-4def-808c-568767aca32e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:55.846626 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ad509c64-85dc-4def-808c-568767aca32e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:55.847050 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ad509c64-85dc-4def-808c-568767aca32e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:55.988050 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ad509c64-85dc-4def-808c-568767aca32e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:55.995424 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ad509c64-85dc-4def-808c-568767aca32e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.160444 Oct 13 04:20:56.001897 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 268/545] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:55 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:56.137642 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-90435fb8-9599-4ab8-988a-b769469b5ddd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:56.138334 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-90435fb8-9599-4ab8-988a-b769469b5ddd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:56.145118 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-90435fb8-9599-4ab8-988a-b769469b5ddd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:56.145571 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-90435fb8-9599-4ab8-988a-b769469b5ddd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:56.146546 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-90435fb8-9599-4ab8-988a-b769469b5ddd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:56.146973 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-90435fb8-9599-4ab8-988a-b769469b5ddd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:56.498513 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-90435fb8-9599-4ab8-988a-b769469b5ddd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:56.506511 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-90435fb8-9599-4ab8-988a-b769469b5ddd tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 200 len: 1515 microversion: 2.1 time: 0.372906 Oct 13 04:20:56.507142 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 278/546] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:56 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 1515 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:56.532638 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-edbe700e-9da8-473d-ba5a-32c1b3292862 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:56.533826 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-edbe700e-9da8-473d-ba5a-32c1b3292862 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:56.541371 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-edbe700e-9da8-473d-ba5a-32c1b3292862 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:56.541862 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-edbe700e-9da8-473d-ba5a-32c1b3292862 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:56.542636 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-edbe700e-9da8-473d-ba5a-32c1b3292862 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:56.543085 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-edbe700e-9da8-473d-ba5a-32c1b3292862 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:56.620339 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-edbe700e-9da8-473d-ba5a-32c1b3292862 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 28616 microversion: 2.20 time: 0.091400 Oct 13 04:20:56.621002 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 269/547] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:56 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 28616 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:20:56.675253 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-649a3e8f-41d2-410a-9f5f-bad8d13ce70d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:56.676242 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-649a3e8f-41d2-410a-9f5f-bad8d13ce70d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:56.686405 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-649a3e8f-41d2-410a-9f5f-bad8d13ce70d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:56.687134 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-649a3e8f-41d2-410a-9f5f-bad8d13ce70d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:56.688377 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-649a3e8f-41d2-410a-9f5f-bad8d13ce70d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:56.689090 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-649a3e8f-41d2-410a-9f5f-bad8d13ce70d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:56.744945 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7511db05-afca-4624-a272-7ddadcf2fe67 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:56.746225 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7511db05-afca-4624-a272-7ddadcf2fe67 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:56.753825 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7511db05-afca-4624-a272-7ddadcf2fe67 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:56.754498 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-649a3e8f-41d2-410a-9f5f-bad8d13ce70d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:56.755525 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7511db05-afca-4624-a272-7ddadcf2fe67 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:56.756478 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7511db05-afca-4624-a272-7ddadcf2fe67 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:56.757107 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7511db05-afca-4624-a272-7ddadcf2fe67 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:56.762721 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-649a3e8f-41d2-410a-9f5f-bad8d13ce70d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1310 microversion: 2.1 time: 0.093476 Oct 13 04:20:56.763495 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 279/548] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:56 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:56.842159 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7511db05-afca-4624-a272-7ddadcf2fe67 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 28625 microversion: 2.1 time: 0.101136 Oct 13 04:20:56.842802 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 270/549] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:56 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 28625 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:20:57.012240 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d421eb54-2113-49be-975b-dcd72082283b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:57.013034 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d421eb54-2113-49be-975b-dcd72082283b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:57.019101 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d421eb54-2113-49be-975b-dcd72082283b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:57.019995 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d421eb54-2113-49be-975b-dcd72082283b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:57.020757 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d421eb54-2113-49be-975b-dcd72082283b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:57.021373 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d421eb54-2113-49be-975b-dcd72082283b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:57.265425 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d421eb54-2113-49be-975b-dcd72082283b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:57.272948 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d421eb54-2113-49be-975b-dcd72082283b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1500 microversion: 2.1 time: 0.264535 Oct 13 04:20:57.273512 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 280/550] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:57 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1500 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:57.297098 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-48b67790-f4e3-4eab-bf75-b0782764740f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15634373-b348-4b80-951b-3c7dd435ffd2"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:57.298294 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-48b67790-f4e3-4eab-bf75-b0782764740f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:57.304719 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-48b67790-f4e3-4eab-bf75-b0782764740f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:57.305152 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-48b67790-f4e3-4eab-bf75-b0782764740f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:57.305943 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-48b67790-f4e3-4eab-bf75-b0782764740f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:57.306358 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-48b67790-f4e3-4eab-bf75-b0782764740f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:57.338157 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-48b67790-f4e3-4eab-bf75-b0782764740f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] HTTP exception thrown: Cannot 'attach_volume' instance 2b4223c8-bfe1-440e-89bc-7158a1490e1c while it is in vm_state rescued Oct 13 04:20:57.338740 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-48b67790-f4e3-4eab-bf75-b0782764740f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Returning 409 to user: Cannot 'attach_volume' instance 2b4223c8-bfe1-440e-89bc-7158a1490e1c while it is in vm_state rescued {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:20:57.339622 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-48b67790-f4e3-4eab-bf75-b0782764740f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "POST /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047926 Oct 13 04:20:57.340467 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 271/551] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Oct 13 04:20:57 2021] POST /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 13 04:20:57.349670 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-658a2bea-91b6-446d-b71a-44f0d6d37e35 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:57.350408 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-658a2bea-91b6-446d-b71a-44f0d6d37e35 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:57.356669 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-658a2bea-91b6-446d-b71a-44f0d6d37e35 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:57.357320 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-658a2bea-91b6-446d-b71a-44f0d6d37e35 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:57.358564 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-658a2bea-91b6-446d-b71a-44f0d6d37e35 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:57.359292 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-658a2bea-91b6-446d-b71a-44f0d6d37e35 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:57.440674 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-658a2bea-91b6-446d-b71a-44f0d6d37e35 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "POST /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/action" status: 202 len: 0 microversion: 2.1 time: 0.094101 Oct 13 04:20:57.441651 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 281/552] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:57 2021] POST /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:20:57.451327 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-47b33a0d-6c21-44cc-9c58-e02e276aa556 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:57.451834 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-47b33a0d-6c21-44cc-9c58-e02e276aa556 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:57.460179 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-47b33a0d-6c21-44cc-9c58-e02e276aa556 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:57.460768 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-47b33a0d-6c21-44cc-9c58-e02e276aa556 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:57.462265 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-47b33a0d-6c21-44cc-9c58-e02e276aa556 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:57.462265 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-47b33a0d-6c21-44cc-9c58-e02e276aa556 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:57.524826 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-87c6b1c2-1bd7-4200-a592-6373d8705a3f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:57.525835 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-87c6b1c2-1bd7-4200-a592-6373d8705a3f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:57.534821 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-87c6b1c2-1bd7-4200-a592-6373d8705a3f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:57.535592 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-87c6b1c2-1bd7-4200-a592-6373d8705a3f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:57.536941 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-87c6b1c2-1bd7-4200-a592-6373d8705a3f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:57.537383 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-87c6b1c2-1bd7-4200-a592-6373d8705a3f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:57.556278 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 04:20:57.556477 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: Wed Oct 13 04:20:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 (ip 10.222.0.55) !!! Oct 13 04:20:58.000478 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-47b33a0d-6c21-44cc-9c58-e02e276aa556 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:58.008408 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-47b33a0d-6c21-44cc-9c58-e02e276aa556 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1508 microversion: 2.1 time: 0.562738 Oct 13 04:20:58.019176 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 272/553] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:57 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1508 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:20:58.024743 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f201403f-3a75-4375-8250-649860f2f7ac tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:58.026063 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f201403f-3a75-4375-8250-649860f2f7ac tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:58.031505 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-87c6b1c2-1bd7-4200-a592-6373d8705a3f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:58.032343 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f201403f-3a75-4375-8250-649860f2f7ac tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:58.033037 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f201403f-3a75-4375-8250-649860f2f7ac tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:58.034058 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f201403f-3a75-4375-8250-649860f2f7ac tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:58.034717 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f201403f-3a75-4375-8250-649860f2f7ac tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:58.044109 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-87c6b1c2-1bd7-4200-a592-6373d8705a3f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 200 len: 1515 microversion: 2.1 time: 0.523800 Oct 13 04:20:58.045376 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 282/554] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:57 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 1515 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:20:58.058655 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d0b18f61-c34b-4474-bcd5-8fc68b08ea74 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:20:58.065350 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d0b18f61-c34b-4474-bcd5-8fc68b08ea74 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:58.074779 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d0b18f61-c34b-4474-bcd5-8fc68b08ea74 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:58.075645 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d0b18f61-c34b-4474-bcd5-8fc68b08ea74 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:58.076818 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d0b18f61-c34b-4474-bcd5-8fc68b08ea74 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:58.077781 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d0b18f61-c34b-4474-bcd5-8fc68b08ea74 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:58.178476 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d0b18f61-c34b-4474-bcd5-8fc68b08ea74 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:20:58.187937 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d0b18f61-c34b-4474-bcd5-8fc68b08ea74 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1316 microversion: 2.1 time: 0.141239 Oct 13 04:20:58.200534 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 283/555] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:20:58 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:20:58.205696 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5ec6b9d0-3419-4388-813a-67f5989731d4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:20:58.206978 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5ec6b9d0-3419-4388-813a-67f5989731d4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:20:58.218474 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5ec6b9d0-3419-4388-813a-67f5989731d4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:58.219564 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5ec6b9d0-3419-4388-813a-67f5989731d4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:20:58.232256 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5ec6b9d0-3419-4388-813a-67f5989731d4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:20:58.234211 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5ec6b9d0-3419-4388-813a-67f5989731d4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:21.473695 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5ec6b9d0-3419-4388-813a-67f5989731d4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 38134 microversion: 2.1 time: 23.271489 Oct 13 04:21:21.474436 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 284/556] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:20:58 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 38134 bytes in 23273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:21:21.479418 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-ac57d6dd-a991-4cb0-85c3-ff2370034f6c req-d1ad8a08-6254-4a97-b481-069c03baeaf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e3d51b-fb51-4ea1-904d-a09c4c2af595", "name": "network-vif-deleted", "tag": "ce77776c-95b9-46ba-b5e4-6e4b1ad6d721"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:21.480914 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:21:21.480914 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:21:21.488489 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-ac57d6dd-a991-4cb0-85c3-ff2370034f6c req-d1ad8a08-6254-4a97-b481-069c03baeaf3 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:21.488894 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-ac57d6dd-a991-4cb0-85c3-ff2370034f6c req-d1ad8a08-6254-4a97-b481-069c03baeaf3 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:21.500347 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-ac57d6dd-a991-4cb0-85c3-ff2370034f6c req-d1ad8a08-6254-4a97-b481-069c03baeaf3 service nova] Creating event network-vif-deleted:ce77776c-95b9-46ba-b5e4-6e4b1ad6d721 for instance 24e3d51b-fb51-4ea1-904d-a09c4c2af595 on hv-cinder-81275 Oct 13 04:21:21.501971 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f201403f-3a75-4375-8250-649860f2f7ac tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 35829 microversion: 2.20 time: 23.480948 Oct 13 04:21:21.503486 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 273/557] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:20:58 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 35829 bytes in 23483 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:21:21.508409 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-ac57d6dd-a991-4cb0-85c3-ff2370034f6c req-d1ad8a08-6254-4a97-b481-069c03baeaf3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032703 Oct 13 04:21:21.508867 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-dbf4f550-2371-4d8c-9a77-31a30099c57d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:21.509483 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 285/558] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:21:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:21.509904 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-dbf4f550-2371-4d8c-9a77-31a30099c57d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:21.514807 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-881db70c-3319-44b3-84f1-a5f8be90fbe2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:21.515529 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-881db70c-3319-44b3-84f1-a5f8be90fbe2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:21.520753 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dbf4f550-2371-4d8c-9a77-31a30099c57d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:21.521205 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dbf4f550-2371-4d8c-9a77-31a30099c57d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:21.522009 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dbf4f550-2371-4d8c-9a77-31a30099c57d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:21.522458 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dbf4f550-2371-4d8c-9a77-31a30099c57d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:21.522950 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-881db70c-3319-44b3-84f1-a5f8be90fbe2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:21.523405 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-881db70c-3319-44b3-84f1-a5f8be90fbe2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:21.524160 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-881db70c-3319-44b3-84f1-a5f8be90fbe2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:21.524599 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-881db70c-3319-44b3-84f1-a5f8be90fbe2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:21.649050 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-881db70c-3319-44b3-84f1-a5f8be90fbe2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:21.656639 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-881db70c-3319-44b3-84f1-a5f8be90fbe2 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 200 len: 1303 microversion: 2.1 time: 0.145657 Oct 13 04:21:21.657238 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 286/559] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:21 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 1303 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:21.662238 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-8ebe752c-e9f1-4fb0-a504-c3d173c6c2c8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:21.662886 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-8ebe752c-e9f1-4fb0-a504-c3d173c6c2c8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:21.669894 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8ebe752c-e9f1-4fb0-a504-c3d173c6c2c8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:21.670342 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8ebe752c-e9f1-4fb0-a504-c3d173c6c2c8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:21.671291 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8ebe752c-e9f1-4fb0-a504-c3d173c6c2c8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:21.671719 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8ebe752c-e9f1-4fb0-a504-c3d173c6c2c8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:21.956638 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-dbf4f550-2371-4d8c-9a77-31a30099c57d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:21.964659 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-dbf4f550-2371-4d8c-9a77-31a30099c57d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1508 microversion: 2.1 time: 0.460034 Oct 13 04:21:21.965601 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 274/560] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:21 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1508 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:22.046929 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-8ebe752c-e9f1-4fb0-a504-c3d173c6c2c8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:22.054349 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-8ebe752c-e9f1-4fb0-a504-c3d173c6c2c8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1358 microversion: 2.1 time: 0.396120 Oct 13 04:21:22.054918 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 287/561] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:21 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1358 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:22.486248 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d65e68b5-5e9e-42ab-9444-aa430cf43e10 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:22.487624 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d65e68b5-5e9e-42ab-9444-aa430cf43e10 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:22.492947 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d65e68b5-5e9e-42ab-9444-aa430cf43e10 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:22.493467 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d65e68b5-5e9e-42ab-9444-aa430cf43e10 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:22.494251 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d65e68b5-5e9e-42ab-9444-aa430cf43e10 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:22.494671 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d65e68b5-5e9e-42ab-9444-aa430cf43e10 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:22.517678 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-65dad6a4-da1e-4c52-b490-2b9a15ac6c78 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:22.518683 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-65dad6a4-da1e-4c52-b490-2b9a15ac6c78 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:22.525203 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-65dad6a4-da1e-4c52-b490-2b9a15ac6c78 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:22.525874 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-65dad6a4-da1e-4c52-b490-2b9a15ac6c78 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:22.526718 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-65dad6a4-da1e-4c52-b490-2b9a15ac6c78 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:22.527203 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-65dad6a4-da1e-4c52-b490-2b9a15ac6c78 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:22.584300 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d65e68b5-5e9e-42ab-9444-aa430cf43e10 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 38134 microversion: 2.1 time: 0.101521 Oct 13 04:21:22.585283 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 275/562] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:21:22 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 38134 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:21:22.637032 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-65dad6a4-da1e-4c52-b490-2b9a15ac6c78 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 37129 microversion: 2.20 time: 0.126518 Oct 13 04:21:22.642252 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 288/563] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:21:22 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 37129 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:21:22.673738 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5f341a18-73f2-4ad2-849b-0030974eec80 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:22.674786 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-5f341a18-73f2-4ad2-849b-0030974eec80 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: 24e3d51b-fb51-4ea1-904d-a09c4c2af595] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:22.684540 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5f341a18-73f2-4ad2-849b-0030974eec80 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:22.685255 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5f341a18-73f2-4ad2-849b-0030974eec80 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:22.686088 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5f341a18-73f2-4ad2-849b-0030974eec80 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:22.686524 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5f341a18-73f2-4ad2-849b-0030974eec80 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:22.701236 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-5f341a18-73f2-4ad2-849b-0030974eec80 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] HTTP exception thrown: Instance 24e3d51b-fb51-4ea1-904d-a09c4c2af595 could not be found. Oct 13 04:21:22.702022 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5f341a18-73f2-4ad2-849b-0030974eec80 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Returning 404 to user: Instance 24e3d51b-fb51-4ea1-904d-a09c4c2af595 could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:21:22.702859 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-5f341a18-73f2-4ad2-849b-0030974eec80 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595" status: 404 len: 111 microversion: 2.1 time: 0.033332 Oct 13 04:21:22.703589 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 276/564] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:22 2021] GET /compute/v2.1/servers/24e3d51b-fb51-4ea1-904d-a09c4c2af595 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:21:22.982377 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-0dc54d7b-d036-4ea6-8b6b-94dfbc7f3c65 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:22.982985 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-0dc54d7b-d036-4ea6-8b6b-94dfbc7f3c65 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:22.989852 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0dc54d7b-d036-4ea6-8b6b-94dfbc7f3c65 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:22.990320 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0dc54d7b-d036-4ea6-8b6b-94dfbc7f3c65 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:22.991054 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0dc54d7b-d036-4ea6-8b6b-94dfbc7f3c65 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:22.991478 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0dc54d7b-d036-4ea6-8b6b-94dfbc7f3c65 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:23.071503 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-98a76ac2-3f4c-4f5a-a3f8-ff8699af44d8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:23.072108 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-98a76ac2-3f4c-4f5a-a3f8-ff8699af44d8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:23.078285 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-98a76ac2-3f4c-4f5a-a3f8-ff8699af44d8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:23.078725 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-98a76ac2-3f4c-4f5a-a3f8-ff8699af44d8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:23.079482 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-98a76ac2-3f4c-4f5a-a3f8-ff8699af44d8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:23.079908 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-98a76ac2-3f4c-4f5a-a3f8-ff8699af44d8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:23.185352 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-0dc54d7b-d036-4ea6-8b6b-94dfbc7f3c65 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:23.193993 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-0dc54d7b-d036-4ea6-8b6b-94dfbc7f3c65 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1508 microversion: 2.1 time: 0.215368 Oct 13 04:21:23.194810 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 289/565] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:22 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:23.238874 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-98a76ac2-3f4c-4f5a-a3f8-ff8699af44d8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:23.247163 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-98a76ac2-3f4c-4f5a-a3f8-ff8699af44d8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1358 microversion: 2.1 time: 0.179546 Oct 13 04:21:23.247701 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 277/566] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:23 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:23.532327 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-6e782c36-20ce-4eef-b147-e810bd8f1d60 req-1b75375c-2df3-4c2a-ba1a-1fd87c9c7944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e01f589-9c51-46fc-ba95-f16538ccba87", "tag": "0bd06624-1837-4923-9daf-aa14f17b4981"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:23.534814 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:21:23.534814 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:21:23.548598 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-6e782c36-20ce-4eef-b147-e810bd8f1d60 req-1b75375c-2df3-4c2a-ba1a-1fd87c9c7944 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:23.548598 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-6e782c36-20ce-4eef-b147-e810bd8f1d60 req-1b75375c-2df3-4c2a-ba1a-1fd87c9c7944 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:23.555913 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-6e782c36-20ce-4eef-b147-e810bd8f1d60 req-1b75375c-2df3-4c2a-ba1a-1fd87c9c7944 service nova] Creating event network-changed:0bd06624-1837-4923-9daf-aa14f17b4981 for instance 7e01f589-9c51-46fc-ba95-f16538ccba87 on hv-cinder-81275 Oct 13 04:21:23.560898 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-6e782c36-20ce-4eef-b147-e810bd8f1d60 req-1b75375c-2df3-4c2a-ba1a-1fd87c9c7944 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032162 Oct 13 04:21:23.561478 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 290/567] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:21:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:23.596295 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c2696230-c64f-4507-9e38-de4e4b01fe0e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:23.597262 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c2696230-c64f-4507-9e38-de4e4b01fe0e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:23.603705 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2696230-c64f-4507-9e38-de4e4b01fe0e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:23.604138 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2696230-c64f-4507-9e38-de4e4b01fe0e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:23.604903 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2696230-c64f-4507-9e38-de4e4b01fe0e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:23.605345 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2696230-c64f-4507-9e38-de4e4b01fe0e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:23.649728 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e79a0948-8728-465e-9695-0959d4a22616 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:23.650679 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e79a0948-8728-465e-9695-0959d4a22616 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:23.657063 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e79a0948-8728-465e-9695-0959d4a22616 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:23.657498 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e79a0948-8728-465e-9695-0959d4a22616 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:23.658296 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e79a0948-8728-465e-9695-0959d4a22616 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:23.658712 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e79a0948-8728-465e-9695-0959d4a22616 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:24.212704 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e79a0948-8728-465e-9695-0959d4a22616 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 38145 microversion: 2.20 time: 0.558789 Oct 13 04:21:24.212704 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 291/568] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:21:23 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 38145 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:21:24.213624 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c2696230-c64f-4507-9e38-de4e4b01fe0e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 38134 microversion: 2.1 time: 0.620378 Oct 13 04:21:24.214275 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d337a72f-26b3-45e9-9d06-da109c5e5daa tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:24.214854 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d337a72f-26b3-45e9-9d06-da109c5e5daa tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:24.218955 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 278/569] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:21:23 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 38134 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:21:24.221936 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d337a72f-26b3-45e9-9d06-da109c5e5daa tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:24.222545 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d337a72f-26b3-45e9-9d06-da109c5e5daa tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:24.223397 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d337a72f-26b3-45e9-9d06-da109c5e5daa tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:24.223985 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d337a72f-26b3-45e9-9d06-da109c5e5daa tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:24.224190 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5aa9d8e9-9e77-4d35-8c98-bcc5a2ad2adb tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:24.224866 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-5aa9d8e9-9e77-4d35-8c98-bcc5a2ad2adb tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:24.233501 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5aa9d8e9-9e77-4d35-8c98-bcc5a2ad2adb tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:24.234269 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5aa9d8e9-9e77-4d35-8c98-bcc5a2ad2adb tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:24.235037 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5aa9d8e9-9e77-4d35-8c98-bcc5a2ad2adb tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:24.235460 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5aa9d8e9-9e77-4d35-8c98-bcc5a2ad2adb tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:24.256031 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d337a72f-26b3-45e9-9d06-da109c5e5daa tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Going to try to terminate instance {{(pid=108260) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:21:24.332740 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d337a72f-26b3-45e9-9d06-da109c5e5daa tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 204 len: 0 microversion: 2.1 time: 0.123840 Oct 13 04:21:24.333387 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 292/570] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:21:24 2021] DELETE /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:21:24.338779 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-91c7da0d-3847-43de-ba8f-db7e5c6c0926 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:24.339476 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-91c7da0d-3847-43de-ba8f-db7e5c6c0926 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:24.345474 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-91c7da0d-3847-43de-ba8f-db7e5c6c0926 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:24.345957 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-91c7da0d-3847-43de-ba8f-db7e5c6c0926 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:24.346727 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-91c7da0d-3847-43de-ba8f-db7e5c6c0926 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:24.347156 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-91c7da0d-3847-43de-ba8f-db7e5c6c0926 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:24.364789 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-5aa9d8e9-9e77-4d35-8c98-bcc5a2ad2adb tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:24.372167 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-5aa9d8e9-9e77-4d35-8c98-bcc5a2ad2adb tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1508 microversion: 2.1 time: 0.152269 Oct 13 04:21:24.372814 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 279/571] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:24 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:24.386244 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-92545e5e-8d9b-48dd-a9ac-0f9a80255e43 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:24.386947 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-92545e5e-8d9b-48dd-a9ac-0f9a80255e43 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:24.392832 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-92545e5e-8d9b-48dd-a9ac-0f9a80255e43 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:24.393270 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-92545e5e-8d9b-48dd-a9ac-0f9a80255e43 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:24.394056 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-92545e5e-8d9b-48dd-a9ac-0f9a80255e43 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:24.394479 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-92545e5e-8d9b-48dd-a9ac-0f9a80255e43 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:24.488677 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-91c7da0d-3847-43de-ba8f-db7e5c6c0926 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:24.496337 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-91c7da0d-3847-43de-ba8f-db7e5c6c0926 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1358 microversion: 2.1 time: 0.161732 Oct 13 04:21:24.496858 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 293/572] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:24 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:24.538819 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-92545e5e-8d9b-48dd-a9ac-0f9a80255e43 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:24.546487 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-92545e5e-8d9b-48dd-a9ac-0f9a80255e43 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1512 microversion: 2.1 time: 0.163833 Oct 13 04:21:24.547020 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 280/573] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:24 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:25.221098 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-313b73ff-f1b4-4a2a-86bd-fbc424b1610f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:25.222069 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-313b73ff-f1b4-4a2a-86bd-fbc424b1610f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:25.225311 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3a7d3589-4556-416e-ae8b-37b2613892b3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:25.226370 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3a7d3589-4556-416e-ae8b-37b2613892b3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:25.229222 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-313b73ff-f1b4-4a2a-86bd-fbc424b1610f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:25.229729 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-313b73ff-f1b4-4a2a-86bd-fbc424b1610f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:25.230523 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-313b73ff-f1b4-4a2a-86bd-fbc424b1610f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:25.230955 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-313b73ff-f1b4-4a2a-86bd-fbc424b1610f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:25.233068 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3a7d3589-4556-416e-ae8b-37b2613892b3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:25.233523 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3a7d3589-4556-416e-ae8b-37b2613892b3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:25.234323 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3a7d3589-4556-416e-ae8b-37b2613892b3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:25.234753 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3a7d3589-4556-416e-ae8b-37b2613892b3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:25.315367 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-313b73ff-f1b4-4a2a-86bd-fbc424b1610f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 38145 microversion: 2.20 time: 0.098426 Oct 13 04:21:25.315916 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 294/574] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:21:25 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 38145 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:21:25.332787 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3a7d3589-4556-416e-ae8b-37b2613892b3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 38134 microversion: 2.1 time: 0.110928 Oct 13 04:21:25.333433 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 281/575] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:21:25 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 38134 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:21:25.392471 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a40ed762-c220-4916-b023-d8d1057dc591 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:25.393425 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a40ed762-c220-4916-b023-d8d1057dc591 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:25.403168 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a40ed762-c220-4916-b023-d8d1057dc591 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:25.403784 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a40ed762-c220-4916-b023-d8d1057dc591 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:25.404912 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a40ed762-c220-4916-b023-d8d1057dc591 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:25.405508 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a40ed762-c220-4916-b023-d8d1057dc591 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:25.513231 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-83f6ef16-f6d0-4f84-92f2-f5440597d348 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:25.513954 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-83f6ef16-f6d0-4f84-92f2-f5440597d348 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:25.521411 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-83f6ef16-f6d0-4f84-92f2-f5440597d348 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:25.521883 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-83f6ef16-f6d0-4f84-92f2-f5440597d348 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:25.522676 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-83f6ef16-f6d0-4f84-92f2-f5440597d348 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:25.523093 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-83f6ef16-f6d0-4f84-92f2-f5440597d348 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:25.544377 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a40ed762-c220-4916-b023-d8d1057dc591 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:25.554211 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a40ed762-c220-4916-b023-d8d1057dc591 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1508 microversion: 2.1 time: 0.167556 Oct 13 04:21:25.555031 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 295/576] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:25 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:25.562668 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c4061d09-ac04-4da0-ab83-a47674547c3d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:25.563341 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c4061d09-ac04-4da0-ab83-a47674547c3d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:25.569635 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c4061d09-ac04-4da0-ab83-a47674547c3d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:25.570008 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c4061d09-ac04-4da0-ab83-a47674547c3d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:25.570769 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c4061d09-ac04-4da0-ab83-a47674547c3d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:25.571185 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c4061d09-ac04-4da0-ab83-a47674547c3d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:25.671038 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-83f6ef16-f6d0-4f84-92f2-f5440597d348 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:25.678769 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-83f6ef16-f6d0-4f84-92f2-f5440597d348 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1358 microversion: 2.1 time: 0.169575 Oct 13 04:21:25.679699 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 282/577] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:25 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:25.718002 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-c4061d09-ac04-4da0-ab83-a47674547c3d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:25.725260 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c4061d09-ac04-4da0-ab83-a47674547c3d tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1512 microversion: 2.1 time: 0.166063 Oct 13 04:21:25.725887 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 296/578] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:25 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:26.331699 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-de0c9f49-e687-4854-877b-2cec3b7cbefb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:26.333103 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-de0c9f49-e687-4854-877b-2cec3b7cbefb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:26.340993 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-de0c9f49-e687-4854-877b-2cec3b7cbefb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:26.341437 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-de0c9f49-e687-4854-877b-2cec3b7cbefb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:26.342235 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-de0c9f49-e687-4854-877b-2cec3b7cbefb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:26.342640 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-de0c9f49-e687-4854-877b-2cec3b7cbefb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:26.344183 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-bcd16302-d155-45d9-ac82-4858dd633bd9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:26.345148 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-bcd16302-d155-45d9-ac82-4858dd633bd9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:26.351301 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bcd16302-d155-45d9-ac82-4858dd633bd9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:26.351737 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bcd16302-d155-45d9-ac82-4858dd633bd9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:26.352485 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bcd16302-d155-45d9-ac82-4858dd633bd9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:26.352904 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bcd16302-d155-45d9-ac82-4858dd633bd9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:26.451557 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-bcd16302-d155-45d9-ac82-4858dd633bd9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 200 len: 38265 microversion: 2.1 time: 0.110394 Oct 13 04:21:26.452542 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 297/579] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:21:26 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 38265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:21:26.466117 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-fcfc680e-5142-4e74-97e0-46c70de5b167 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:26.466675 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-fcfc680e-5142-4e74-97e0-46c70de5b167 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:26.473375 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fcfc680e-5142-4e74-97e0-46c70de5b167 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:26.473577 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-de0c9f49-e687-4854-877b-2cec3b7cbefb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 38145 microversion: 2.20 time: 0.148146 Oct 13 04:21:26.473847 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fcfc680e-5142-4e74-97e0-46c70de5b167 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:26.474472 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 283/580] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:21:26 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 38145 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:21:26.474608 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fcfc680e-5142-4e74-97e0-46c70de5b167 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:26.475019 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fcfc680e-5142-4e74-97e0-46c70de5b167 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:26.498889 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-fcfc680e-5142-4e74-97e0-46c70de5b167 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/ips" status: 200 len: 146 microversion: 2.1 time: 0.036423 Oct 13 04:21:26.499444 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 298/581] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Oct 13 04:21:26 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:26.573572 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c233f5a9-558d-45c6-be97-2fe67c3e50d1 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:26.574377 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c233f5a9-558d-45c6-be97-2fe67c3e50d1 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:26.581492 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c233f5a9-558d-45c6-be97-2fe67c3e50d1 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:26.582026 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c233f5a9-558d-45c6-be97-2fe67c3e50d1 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:26.582720 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c233f5a9-558d-45c6-be97-2fe67c3e50d1 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:26.583148 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c233f5a9-558d-45c6-be97-2fe67c3e50d1 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:26.695618 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-0fba8acd-6517-440b-94fd-e6b9c970a467 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:26.696337 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-0fba8acd-6517-440b-94fd-e6b9c970a467 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:26.702583 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0fba8acd-6517-440b-94fd-e6b9c970a467 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:26.703021 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0fba8acd-6517-440b-94fd-e6b9c970a467 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:26.703769 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0fba8acd-6517-440b-94fd-e6b9c970a467 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:26.704161 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0fba8acd-6517-440b-94fd-e6b9c970a467 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:26.715442 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c233f5a9-558d-45c6-be97-2fe67c3e50d1 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:26.723393 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c233f5a9-558d-45c6-be97-2fe67c3e50d1 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1508 microversion: 2.1 time: 0.154142 Oct 13 04:21:26.724281 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 284/582] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:26 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:26.741964 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-05152e51-8703-4fc8-a6a5-f288ce4b0216 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:26.742565 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-05152e51-8703-4fc8-a6a5-f288ce4b0216 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:26.748793 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-05152e51-8703-4fc8-a6a5-f288ce4b0216 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:26.749235 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-05152e51-8703-4fc8-a6a5-f288ce4b0216 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:26.750037 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-05152e51-8703-4fc8-a6a5-f288ce4b0216 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:26.750457 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-05152e51-8703-4fc8-a6a5-f288ce4b0216 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:26.847894 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-0fba8acd-6517-440b-94fd-e6b9c970a467 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:26.855479 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-0fba8acd-6517-440b-94fd-e6b9c970a467 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1358 microversion: 2.1 time: 0.163526 Oct 13 04:21:26.856040 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 299/583] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:26 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:26.899575 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-05152e51-8703-4fc8-a6a5-f288ce4b0216 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:26.907518 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-05152e51-8703-4fc8-a6a5-f288ce4b0216 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1512 microversion: 2.1 time: 0.169127 Oct 13 04:21:26.908073 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 285/584] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:26 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:27.487597 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-8257bfe1-e433-45f6-9e92-bfa33ed7c56d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:27.488541 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-8257bfe1-e433-45f6-9e92-bfa33ed7c56d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:27.495033 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8257bfe1-e433-45f6-9e92-bfa33ed7c56d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:27.495747 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8257bfe1-e433-45f6-9e92-bfa33ed7c56d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:27.496563 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8257bfe1-e433-45f6-9e92-bfa33ed7c56d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:27.496991 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8257bfe1-e433-45f6-9e92-bfa33ed7c56d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:27.524845 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-c3910186-22aa-4acf-b020-942af4a71024 req-5de01556-7009-4e95-aec4-6689f30c3975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58316e9-818c-4986-9148-932d51f34cc9", "name": "network-vif-deleted", "tag": "355dc108-256f-4efe-8035-feb0a826461d"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:27.527427 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:21:27.527427 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:21:27.534565 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-c3910186-22aa-4acf-b020-942af4a71024 req-5de01556-7009-4e95-aec4-6689f30c3975 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:27.535025 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-c3910186-22aa-4acf-b020-942af4a71024 req-5de01556-7009-4e95-aec4-6689f30c3975 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:27.547247 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-c3910186-22aa-4acf-b020-942af4a71024 req-5de01556-7009-4e95-aec4-6689f30c3975 service nova] Creating event network-vif-deleted:355dc108-256f-4efe-8035-feb0a826461d for instance d58316e9-818c-4986-9148-932d51f34cc9 on hv-cinder-81275 Oct 13 04:21:27.552122 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-c3910186-22aa-4acf-b020-942af4a71024 req-5de01556-7009-4e95-aec4-6689f30c3975 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031305 Oct 13 04:21:27.552795 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 286/585] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:21:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:27.610840 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-8257bfe1-e433-45f6-9e92-bfa33ed7c56d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 38145 microversion: 2.20 time: 0.128130 Oct 13 04:21:27.611960 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 300/586] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:21:27 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 38145 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:21:27.741155 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e1c4a0c0-d031-4595-a7e0-96002b108b2b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:27.741882 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e1c4a0c0-d031-4595-a7e0-96002b108b2b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:27.748282 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e1c4a0c0-d031-4595-a7e0-96002b108b2b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:27.748716 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e1c4a0c0-d031-4595-a7e0-96002b108b2b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:27.749464 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e1c4a0c0-d031-4595-a7e0-96002b108b2b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:27.749910 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e1c4a0c0-d031-4595-a7e0-96002b108b2b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:27.872831 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5d2b9e59-01f2-4d16-9fb7-73612ae4e9ce tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:27.873534 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5d2b9e59-01f2-4d16-9fb7-73612ae4e9ce tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:27.880292 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5d2b9e59-01f2-4d16-9fb7-73612ae4e9ce tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:27.881091 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5d2b9e59-01f2-4d16-9fb7-73612ae4e9ce tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:27.882117 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5d2b9e59-01f2-4d16-9fb7-73612ae4e9ce tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:27.882754 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5d2b9e59-01f2-4d16-9fb7-73612ae4e9ce tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:27.892120 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-e1c4a0c0-d031-4595-a7e0-96002b108b2b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:27.900756 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e1c4a0c0-d031-4595-a7e0-96002b108b2b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1508 microversion: 2.1 time: 0.163964 Oct 13 04:21:27.901523 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 287/587] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:27 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:27.924309 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e220457b-3946-4e5b-b78c-ead0f74f740a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:27.924998 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e220457b-3946-4e5b-b78c-ead0f74f740a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:27.931147 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e220457b-3946-4e5b-b78c-ead0f74f740a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:27.931596 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e220457b-3946-4e5b-b78c-ead0f74f740a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:27.932446 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e220457b-3946-4e5b-b78c-ead0f74f740a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:27.932881 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e220457b-3946-4e5b-b78c-ead0f74f740a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:27.973348 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e220457b-3946-4e5b-b78c-ead0f74f740a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:27.973826 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e220457b-3946-4e5b-b78c-ead0f74f740a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:27.974285 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-e220457b-3946-4e5b-b78c-ead0f74f740a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lazy-loading 'fault' on Instance uuid d58316e9-818c-4986-9148-932d51f34cc9 {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:21:28.019212 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-e220457b-3946-4e5b-b78c-ead0f74f740a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:28.027198 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e220457b-3946-4e5b-b78c-ead0f74f740a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 200 len: 1306 microversion: 2.1 time: 0.106458 Oct 13 04:21:28.028341 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 288/588] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:27 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 1306 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:21:28.054505 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5d2b9e59-01f2-4d16-9fb7-73612ae4e9ce tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:28.064212 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5d2b9e59-01f2-4d16-9fb7-73612ae4e9ce tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1358 microversion: 2.1 time: 0.195463 Oct 13 04:21:28.064786 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 301/589] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:27 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:28.623545 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4a7b8361-24ab-496c-8efc-47f1da410ae6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:28.624372 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4a7b8361-24ab-496c-8efc-47f1da410ae6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:28.631107 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4a7b8361-24ab-496c-8efc-47f1da410ae6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:28.631561 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4a7b8361-24ab-496c-8efc-47f1da410ae6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:28.632318 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4a7b8361-24ab-496c-8efc-47f1da410ae6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:28.632743 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4a7b8361-24ab-496c-8efc-47f1da410ae6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:28.741928 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4a7b8361-24ab-496c-8efc-47f1da410ae6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 200 len: 38286 microversion: 2.20 time: 0.122235 Oct 13 04:21:28.742652 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 289/590] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:21:28 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 38286 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:21:28.753036 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-337e6426-9568-41da-804e-ee87173ca622 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:28.753595 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-337e6426-9568-41da-804e-ee87173ca622 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:28.759901 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-337e6426-9568-41da-804e-ee87173ca622 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:28.760428 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-337e6426-9568-41da-804e-ee87173ca622 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:28.761185 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-337e6426-9568-41da-804e-ee87173ca622 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:28.761624 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-337e6426-9568-41da-804e-ee87173ca622 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:28.785578 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-337e6426-9568-41da-804e-ee87173ca622 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/ips" status: 200 len: 150 microversion: 2.20 time: 0.036138 Oct 13 04:21:28.786167 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 302/591] 10.222.0.55 () {60 vars in 1288 bytes} [Wed Oct 13 04:21:28 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:21:28.921142 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-6acb19e4-3fb1-4286-83ff-18d84cfb216d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:28.921977 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-6acb19e4-3fb1-4286-83ff-18d84cfb216d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:28.929182 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6acb19e4-3fb1-4286-83ff-18d84cfb216d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:28.929643 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6acb19e4-3fb1-4286-83ff-18d84cfb216d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:28.930585 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6acb19e4-3fb1-4286-83ff-18d84cfb216d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:28.931097 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6acb19e4-3fb1-4286-83ff-18d84cfb216d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:29.045777 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-356b8afa-abe8-43a2-a5bd-eb1c0fddcfaa tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:29.046587 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-356b8afa-abe8-43a2-a5bd-eb1c0fddcfaa tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d58316e9-818c-4986-9148-932d51f34cc9] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:29.061225 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-356b8afa-abe8-43a2-a5bd-eb1c0fddcfaa tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:29.063889 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-356b8afa-abe8-43a2-a5bd-eb1c0fddcfaa tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:29.066279 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-356b8afa-abe8-43a2-a5bd-eb1c0fddcfaa tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:29.066725 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-356b8afa-abe8-43a2-a5bd-eb1c0fddcfaa tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:29.090005 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-356b8afa-abe8-43a2-a5bd-eb1c0fddcfaa tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] HTTP exception thrown: Instance d58316e9-818c-4986-9148-932d51f34cc9 could not be found. Oct 13 04:21:29.090609 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-356b8afa-abe8-43a2-a5bd-eb1c0fddcfaa tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Returning 404 to user: Instance d58316e9-818c-4986-9148-932d51f34cc9 could not be found. {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:21:29.091434 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-356b8afa-abe8-43a2-a5bd-eb1c0fddcfaa tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9" status: 404 len: 111 microversion: 2.1 time: 0.050084 Oct 13 04:21:29.092166 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 303/592] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:29 2021] GET /compute/v2.1/servers/d58316e9-818c-4986-9148-932d51f34cc9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 04:21:29.097435 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3a823024-1168-4ca6-bb19-33e2d8eac132 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0707ad48-f175-4f51-90c2-f89817740489"}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:29.098700 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3a823024-1168-4ca6-bb19-33e2d8eac132 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:29.108239 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-6acb19e4-3fb1-4286-83ff-18d84cfb216d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:29.109415 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3a823024-1168-4ca6-bb19-33e2d8eac132 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:29.110497 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3a823024-1168-4ca6-bb19-33e2d8eac132 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:29.111741 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3a823024-1168-4ca6-bb19-33e2d8eac132 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:29.112226 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3a823024-1168-4ca6-bb19-33e2d8eac132 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:29.116868 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-6acb19e4-3fb1-4286-83ff-18d84cfb216d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1514 microversion: 2.1 time: 0.201249 Oct 13 04:21:29.128318 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 290/593] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:28 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1514 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:29.134020 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-454ac10b-1019-4dea-b83a-b9c0cff1ef85 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:29.135106 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-454ac10b-1019-4dea-b83a-b9c0cff1ef85 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:29.142062 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-454ac10b-1019-4dea-b83a-b9c0cff1ef85 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:29.142574 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-454ac10b-1019-4dea-b83a-b9c0cff1ef85 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:29.143504 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-454ac10b-1019-4dea-b83a-b9c0cff1ef85 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:29.144177 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-454ac10b-1019-4dea-b83a-b9c0cff1ef85 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:29.309836 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-454ac10b-1019-4dea-b83a-b9c0cff1ef85 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:29.318962 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-454ac10b-1019-4dea-b83a-b9c0cff1ef85 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1358 microversion: 2.1 time: 0.188594 Oct 13 04:21:29.320225 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 291/594] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:29 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:29.326064 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d8cdc8d3-966c-41d8-a910-15e97e55d4b6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:29.327602 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d8cdc8d3-966c-41d8-a910-15e97e55d4b6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:29.335075 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d8cdc8d3-966c-41d8-a910-15e97e55d4b6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:29.335522 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d8cdc8d3-966c-41d8-a910-15e97e55d4b6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:29.336430 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d8cdc8d3-966c-41d8-a910-15e97e55d4b6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:29.336854 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d8cdc8d3-966c-41d8-a910-15e97e55d4b6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:29.367431 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d8cdc8d3-966c-41d8-a910-15e97e55d4b6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Going to try to terminate instance {{(pid=108259) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:21:29.428905 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3a823024-1168-4ca6-bb19-33e2d8eac132 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335356 Oct 13 04:21:29.430087 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 304/595] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Oct 13 04:21:29 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:29.497141 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d8cdc8d3-966c-41d8-a910-15e97e55d4b6 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 204 len: 0 microversion: 2.1 time: 0.175124 Oct 13 04:21:29.498346 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 292/596] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:21:29 2021] DELETE /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:21:29.519356 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2694f66a-e3ff-4fd5-8a00-f857a0ab8e6f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:29.520130 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-2694f66a-e3ff-4fd5-8a00-f857a0ab8e6f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:29.527218 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2694f66a-e3ff-4fd5-8a00-f857a0ab8e6f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:29.527627 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2694f66a-e3ff-4fd5-8a00-f857a0ab8e6f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:29.528702 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2694f66a-e3ff-4fd5-8a00-f857a0ab8e6f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:29.529238 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2694f66a-e3ff-4fd5-8a00-f857a0ab8e6f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:29.664643 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-2694f66a-e3ff-4fd5-8a00-f857a0ab8e6f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:29.672045 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-2694f66a-e3ff-4fd5-8a00-f857a0ab8e6f tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1514 microversion: 2.1 time: 0.168501 Oct 13 04:21:29.672623 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 305/597] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:29 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:30.341721 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e6af7a9b-4735-4685-9072-0e71374b75db tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:30.342718 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e6af7a9b-4735-4685-9072-0e71374b75db tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:30.353321 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e6af7a9b-4735-4685-9072-0e71374b75db tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:30.354172 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e6af7a9b-4735-4685-9072-0e71374b75db tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:30.354989 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e6af7a9b-4735-4685-9072-0e71374b75db tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:30.355427 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e6af7a9b-4735-4685-9072-0e71374b75db tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:30.484070 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-e6af7a9b-4735-4685-9072-0e71374b75db tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:30.496819 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e6af7a9b-4735-4685-9072-0e71374b75db tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1358 microversion: 2.1 time: 0.162121 Oct 13 04:21:30.497389 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 293/598] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:30 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:30.691315 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6f0f4e2a-42c6-46bb-b085-b667cc66af19 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:30.691883 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6f0f4e2a-42c6-46bb-b085-b667cc66af19 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:30.701585 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6f0f4e2a-42c6-46bb-b085-b667cc66af19 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:30.702375 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6f0f4e2a-42c6-46bb-b085-b667cc66af19 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:30.703428 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6f0f4e2a-42c6-46bb-b085-b667cc66af19 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:30.704016 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6f0f4e2a-42c6-46bb-b085-b667cc66af19 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:30.830103 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6f0f4e2a-42c6-46bb-b085-b667cc66af19 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:30.838057 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6f0f4e2a-42c6-46bb-b085-b667cc66af19 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1514 microversion: 2.1 time: 0.152575 Oct 13 04:21:30.838706 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 306/599] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:30 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:31.114543 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d1dcb67a-569c-44a7-86ba-1cf7449b6b02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:31.115060 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d1dcb67a-569c-44a7-86ba-1cf7449b6b02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:31.121735 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d1dcb67a-569c-44a7-86ba-1cf7449b6b02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:31.122177 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d1dcb67a-569c-44a7-86ba-1cf7449b6b02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:31.122928 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d1dcb67a-569c-44a7-86ba-1cf7449b6b02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:31.123353 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d1dcb67a-569c-44a7-86ba-1cf7449b6b02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:31.146714 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-d1dcb67a-569c-44a7-86ba-1cf7449b6b02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lazy-loading 'flavor' on Instance uuid 3c2b8a8f-db02-4581-b497-1f4caa68240f {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:21:31.423553 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d1dcb67a-569c-44a7-86ba-1cf7449b6b02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 202 len: 0 microversion: 2.20 time: 0.312722 Oct 13 04:21:31.424147 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 294/600] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:21:31 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:21:31.432718 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6be4810e-c9f8-4ebf-a80f-cc7be3a45258 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:31.433323 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6be4810e-c9f8-4ebf-a80f-cc7be3a45258 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:31.439334 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6be4810e-c9f8-4ebf-a80f-cc7be3a45258 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:31.440072 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6be4810e-c9f8-4ebf-a80f-cc7be3a45258 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:31.441006 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6be4810e-c9f8-4ebf-a80f-cc7be3a45258 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:31.441514 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6be4810e-c9f8-4ebf-a80f-cc7be3a45258 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:31.514776 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ce628485-d086-46d6-83e7-97dd23e19af3 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:31.515862 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ce628485-d086-46d6-83e7-97dd23e19af3 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:31.522806 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ce628485-d086-46d6-83e7-97dd23e19af3 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:31.523432 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ce628485-d086-46d6-83e7-97dd23e19af3 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:31.524327 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ce628485-d086-46d6-83e7-97dd23e19af3 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:31.524886 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ce628485-d086-46d6-83e7-97dd23e19af3 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:31.678633 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6be4810e-c9f8-4ebf-a80f-cc7be3a45258 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:31.690168 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6be4810e-c9f8-4ebf-a80f-cc7be3a45258 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:31.691869 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6be4810e-c9f8-4ebf-a80f-cc7be3a45258 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:31.693381 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6be4810e-c9f8-4ebf-a80f-cc7be3a45258 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1721 microversion: 2.20 time: 0.264622 Oct 13 04:21:31.694639 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 307/601] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:31 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:31.699424 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-cf4b7959-e4dd-48dc-b812-e3f063a7aed9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:31.700116 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-cf4b7959-e4dd-48dc-b812-e3f063a7aed9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:31.707525 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cf4b7959-e4dd-48dc-b812-e3f063a7aed9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:31.708154 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cf4b7959-e4dd-48dc-b812-e3f063a7aed9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:31.709026 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cf4b7959-e4dd-48dc-b812-e3f063a7aed9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:31.709583 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cf4b7959-e4dd-48dc-b812-e3f063a7aed9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:31.752216 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ce628485-d086-46d6-83e7-97dd23e19af3 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:31.761406 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ce628485-d086-46d6-83e7-97dd23e19af3 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1358 microversion: 2.1 time: 0.250908 Oct 13 04:21:31.762107 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 295/602] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:31 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:31.854788 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a279a271-cd45-464b-bf86-95e3fde5abc0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:31.855538 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a279a271-cd45-464b-bf86-95e3fde5abc0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:31.861739 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a279a271-cd45-464b-bf86-95e3fde5abc0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:31.862180 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a279a271-cd45-464b-bf86-95e3fde5abc0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:31.863649 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a279a271-cd45-464b-bf86-95e3fde5abc0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:31.864095 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a279a271-cd45-464b-bf86-95e3fde5abc0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:31.965066 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-cf4b7959-e4dd-48dc-b812-e3f063a7aed9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:31.978708 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-cf4b7959-e4dd-48dc-b812-e3f063a7aed9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1514 microversion: 2.1 time: 0.282653 Oct 13 04:21:31.979671 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 308/603] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:31 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:31.994603 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7dd19497-01d4-401b-8b0e-0c80f98c26de tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a05b86bd-7ba5-4743-8ad1-bf77418a7c57"}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:31.995753 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7dd19497-01d4-401b-8b0e-0c80f98c26de tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:32.001442 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7dd19497-01d4-401b-8b0e-0c80f98c26de tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:32.002006 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7dd19497-01d4-401b-8b0e-0c80f98c26de tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:32.002673 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7dd19497-01d4-401b-8b0e-0c80f98c26de tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:32.003095 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7dd19497-01d4-401b-8b0e-0c80f98c26de tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:32.075132 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a279a271-cd45-464b-bf86-95e3fde5abc0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:32.083704 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a279a271-cd45-464b-bf86-95e3fde5abc0 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 200 len: 1514 microversion: 2.1 time: 0.232633 Oct 13 04:21:32.093216 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 296/604] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:31 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:32.272834 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-5d6f7f22-f0b6-4f0a-9391-114d96d2a501 req-68a44136-f208-49f6-b030-d30a2350127d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5", "name": "network-vif-deleted", "tag": "0873d595-38af-475f-97a0-d07dd43fbdb5"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:32.275461 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:21:32.275461 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:21:32.300072 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-5d6f7f22-f0b6-4f0a-9391-114d96d2a501 req-68a44136-f208-49f6-b030-d30a2350127d service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:32.300586 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-5d6f7f22-f0b6-4f0a-9391-114d96d2a501 req-68a44136-f208-49f6-b030-d30a2350127d service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:32.320663 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-5d6f7f22-f0b6-4f0a-9391-114d96d2a501 req-68a44136-f208-49f6-b030-d30a2350127d service nova] Creating event network-vif-deleted:0873d595-38af-475f-97a0-d07dd43fbdb5 for instance f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 on hv-cinder-81275 Oct 13 04:21:32.328397 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-5d6f7f22-f0b6-4f0a-9391-114d96d2a501 req-68a44136-f208-49f6-b030-d30a2350127d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059554 Oct 13 04:21:32.329322 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 297/605] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:21:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:32.341934 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7dd19497-01d4-401b-8b0e-0c80f98c26de tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "POST /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350698 Oct 13 04:21:32.347728 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 309/606] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Oct 13 04:21:31 2021] POST /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:21:32.713538 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ea409595-6a70-4079-bbd3-f717da853601 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:32.714356 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ea409595-6a70-4079-bbd3-f717da853601 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:32.721331 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ea409595-6a70-4079-bbd3-f717da853601 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:32.721920 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ea409595-6a70-4079-bbd3-f717da853601 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:32.722749 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ea409595-6a70-4079-bbd3-f717da853601 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:32.723164 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ea409595-6a70-4079-bbd3-f717da853601 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:32.780271 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-dbf962b3-c09e-4df0-8507-1f9cc8c3e183 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:32.781111 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-dbf962b3-c09e-4df0-8507-1f9cc8c3e183 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:32.788657 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dbf962b3-c09e-4df0-8507-1f9cc8c3e183 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:32.789083 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dbf962b3-c09e-4df0-8507-1f9cc8c3e183 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:32.790655 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dbf962b3-c09e-4df0-8507-1f9cc8c3e183 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:32.791449 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dbf962b3-c09e-4df0-8507-1f9cc8c3e183 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:32.897236 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ea409595-6a70-4079-bbd3-f717da853601 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:32.905228 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ea409595-6a70-4079-bbd3-f717da853601 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:32.906760 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ea409595-6a70-4079-bbd3-f717da853601 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:32.907999 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ea409595-6a70-4079-bbd3-f717da853601 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1721 microversion: 2.20 time: 0.199416 Oct 13 04:21:32.908591 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 298/607] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:32 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:32.952870 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-dbf962b3-c09e-4df0-8507-1f9cc8c3e183 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:32.960164 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-dbf962b3-c09e-4df0-8507-1f9cc8c3e183 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1358 microversion: 2.1 time: 0.184668 Oct 13 04:21:32.960729 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 310/608] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:32 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:33.100555 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4eba21f5-4d18-47d1-9265-9830dfb9291b tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:33.101157 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4eba21f5-4d18-47d1-9265-9830dfb9291b tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:33.106989 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4eba21f5-4d18-47d1-9265-9830dfb9291b tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:33.107420 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4eba21f5-4d18-47d1-9265-9830dfb9291b tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:33.108189 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4eba21f5-4d18-47d1-9265-9830dfb9291b tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:33.108610 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4eba21f5-4d18-47d1-9265-9830dfb9291b tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:33.122195 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-4eba21f5-4d18-47d1-9265-9830dfb9291b tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] HTTP exception thrown: Instance f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 could not be found. Oct 13 04:21:33.122800 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4eba21f5-4d18-47d1-9265-9830dfb9291b tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Returning 404 to user: Instance f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:21:33.123565 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4eba21f5-4d18-47d1-9265-9830dfb9291b tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5" status: 404 len: 111 microversion: 2.1 time: 0.026774 Oct 13 04:21:33.124245 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 299/609] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:33 2021] GET /compute/v2.1/servers/f0ed2097-3cf2-44d4-9aaa-df0c0f4c68d5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:21:33.387099 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-0ebc7e3e-be2c-43b8-954e-f9fe492164e3 req-c334ada2-11c7-4cca-bfa7-4ee081af002b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e01f589-9c51-46fc-ba95-f16538ccba87", "name": "network-vif-plugged", "status": "completed", "tag": "0bd06624-1837-4923-9daf-aa14f17b4981"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:33.388882 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:21:33.388882 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:21:33.400773 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-0ebc7e3e-be2c-43b8-954e-f9fe492164e3 req-c334ada2-11c7-4cca-bfa7-4ee081af002b service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:33.401418 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-0ebc7e3e-be2c-43b8-954e-f9fe492164e3 req-c334ada2-11c7-4cca-bfa7-4ee081af002b service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:33.429153 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-0ebc7e3e-be2c-43b8-954e-f9fe492164e3 req-c334ada2-11c7-4cca-bfa7-4ee081af002b service nova] Creating event network-vif-plugged:0bd06624-1837-4923-9daf-aa14f17b4981 for instance 7e01f589-9c51-46fc-ba95-f16538ccba87 on hv-cinder-81275 Oct 13 04:21:33.436690 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-0ebc7e3e-be2c-43b8-954e-f9fe492164e3 req-c334ada2-11c7-4cca-bfa7-4ee081af002b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054124 Oct 13 04:21:33.437513 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 311/610] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:21:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:33.930916 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-da0e0bad-d58b-41e9-89de-e29b933f2795 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:33.931783 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-da0e0bad-d58b-41e9-89de-e29b933f2795 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:33.940948 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-da0e0bad-d58b-41e9-89de-e29b933f2795 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:33.941395 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-da0e0bad-d58b-41e9-89de-e29b933f2795 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:33.942201 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-da0e0bad-d58b-41e9-89de-e29b933f2795 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:33.944391 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-da0e0bad-d58b-41e9-89de-e29b933f2795 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:33.977991 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-296034de-d6e3-4d5b-9c68-84a48f79d32f tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:33.978664 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-296034de-d6e3-4d5b-9c68-84a48f79d32f tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:33.985480 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-296034de-d6e3-4d5b-9c68-84a48f79d32f tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:33.985670 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-296034de-d6e3-4d5b-9c68-84a48f79d32f tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:33.986432 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-296034de-d6e3-4d5b-9c68-84a48f79d32f tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:33.986854 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-296034de-d6e3-4d5b-9c68-84a48f79d32f tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:34.094161 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-da0e0bad-d58b-41e9-89de-e29b933f2795 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:34.102456 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-da0e0bad-d58b-41e9-89de-e29b933f2795 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:34.104053 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-da0e0bad-d58b-41e9-89de-e29b933f2795 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:34.105188 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-da0e0bad-d58b-41e9-89de-e29b933f2795 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1721 microversion: 2.20 time: 0.180854 Oct 13 04:21:34.106066 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 300/611] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:33 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:34.147445 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-296034de-d6e3-4d5b-9c68-84a48f79d32f tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:34.158634 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-296034de-d6e3-4d5b-9c68-84a48f79d32f tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1358 microversion: 2.1 time: 0.184300 Oct 13 04:21:34.159362 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 312/612] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:33 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:34.258309 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-efd11b90-950e-4490-ad22-e91b2becd84a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:34.258796 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-efd11b90-950e-4490-ad22-e91b2becd84a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:34.264810 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-efd11b90-950e-4490-ad22-e91b2becd84a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:34.265251 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-efd11b90-950e-4490-ad22-e91b2becd84a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:34.266042 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-efd11b90-950e-4490-ad22-e91b2becd84a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:34.266468 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-efd11b90-950e-4490-ad22-e91b2becd84a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:34.292858 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-efd11b90-950e-4490-ad22-e91b2becd84a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Going to try to terminate instance {{(pid=108259) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:21:34.373793 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-efd11b90-950e-4490-ad22-e91b2becd84a tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 204 len: 0 microversion: 2.1 time: 0.118861 Oct 13 04:21:34.374487 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 301/613] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:21:34 2021] DELETE /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:21:34.382952 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-82172dc2-0f05-40d3-96e2-307e38c263c7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:34.383556 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-82172dc2-0f05-40d3-96e2-307e38c263c7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:34.389524 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-82172dc2-0f05-40d3-96e2-307e38c263c7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:34.390008 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-82172dc2-0f05-40d3-96e2-307e38c263c7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:34.390757 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-82172dc2-0f05-40d3-96e2-307e38c263c7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:34.391185 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-82172dc2-0f05-40d3-96e2-307e38c263c7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:34.523120 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-82172dc2-0f05-40d3-96e2-307e38c263c7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:34.530867 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-82172dc2-0f05-40d3-96e2-307e38c263c7 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1515 microversion: 2.1 time: 0.152005 Oct 13 04:21:34.531452 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 313/614] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:34 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:35.126255 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d0b0f717-e047-4304-8dff-a4f647d8e241 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:35.127116 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d0b0f717-e047-4304-8dff-a4f647d8e241 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:35.135258 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0b0f717-e047-4304-8dff-a4f647d8e241 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:35.135837 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0b0f717-e047-4304-8dff-a4f647d8e241 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:35.136830 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0b0f717-e047-4304-8dff-a4f647d8e241 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:35.137391 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0b0f717-e047-4304-8dff-a4f647d8e241 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:35.178671 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a9dcde61-ff94-4280-96d2-192c2b5490ae tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:35.179266 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a9dcde61-ff94-4280-96d2-192c2b5490ae tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:35.186005 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a9dcde61-ff94-4280-96d2-192c2b5490ae tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:35.186424 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a9dcde61-ff94-4280-96d2-192c2b5490ae tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:35.187223 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a9dcde61-ff94-4280-96d2-192c2b5490ae tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:35.187651 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a9dcde61-ff94-4280-96d2-192c2b5490ae tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:35.289129 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-d0b0f717-e047-4304-8dff-a4f647d8e241 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:35.296854 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-d0b0f717-e047-4304-8dff-a4f647d8e241 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:35.298400 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-d0b0f717-e047-4304-8dff-a4f647d8e241 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:35.299550 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d0b0f717-e047-4304-8dff-a4f647d8e241 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1721 microversion: 2.20 time: 0.178885 Oct 13 04:21:35.300079 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 302/615] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:35 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:35.338150 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a9dcde61-ff94-4280-96d2-192c2b5490ae tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:35.347794 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a9dcde61-ff94-4280-96d2-192c2b5490ae tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1358 microversion: 2.1 time: 0.172537 Oct 13 04:21:35.348367 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 314/616] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:35 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:35.549477 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0df999e1-edcb-4297-a1a0-6648bdd44563 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:35.551052 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0df999e1-edcb-4297-a1a0-6648bdd44563 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:35.557195 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0df999e1-edcb-4297-a1a0-6648bdd44563 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:35.558686 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0df999e1-edcb-4297-a1a0-6648bdd44563 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:35.559474 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0df999e1-edcb-4297-a1a0-6648bdd44563 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:35.559898 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0df999e1-edcb-4297-a1a0-6648bdd44563 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:35.694877 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-0df999e1-edcb-4297-a1a0-6648bdd44563 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:35.703809 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0df999e1-edcb-4297-a1a0-6648bdd44563 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1515 microversion: 2.1 time: 0.158587 Oct 13 04:21:35.704399 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 303/617] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:35 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:36.317691 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f7414dde-01d2-4a21-9d48-28aa34cd158c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:36.318320 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f7414dde-01d2-4a21-9d48-28aa34cd158c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:36.324780 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f7414dde-01d2-4a21-9d48-28aa34cd158c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:36.325221 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f7414dde-01d2-4a21-9d48-28aa34cd158c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:36.325993 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f7414dde-01d2-4a21-9d48-28aa34cd158c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:36.326415 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f7414dde-01d2-4a21-9d48-28aa34cd158c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:36.364163 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-9f933624-2746-465d-abac-df25a1047538 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:36.364853 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-9f933624-2746-465d-abac-df25a1047538 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:36.371355 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9f933624-2746-465d-abac-df25a1047538 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:36.371874 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9f933624-2746-465d-abac-df25a1047538 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:36.372710 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9f933624-2746-465d-abac-df25a1047538 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:36.373197 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9f933624-2746-465d-abac-df25a1047538 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:36.475866 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f7414dde-01d2-4a21-9d48-28aa34cd158c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:36.484144 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f7414dde-01d2-4a21-9d48-28aa34cd158c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:36.485645 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f7414dde-01d2-4a21-9d48-28aa34cd158c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:36.486873 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f7414dde-01d2-4a21-9d48-28aa34cd158c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1721 microversion: 2.20 time: 0.173355 Oct 13 04:21:36.487412 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 315/618] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:36 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 04:21:36.523742 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-9f933624-2746-465d-abac-df25a1047538 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:36.531308 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-9f933624-2746-465d-abac-df25a1047538 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1549 microversion: 2.1 time: 0.170813 Oct 13 04:21:36.531872 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 304/619] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:36 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:36.548546 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-07609fd2-bced-418a-ab3e-b0ef7b4a3da9 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:36.549155 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-07609fd2-bced-418a-ab3e-b0ef7b4a3da9 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:36.555296 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-07609fd2-bced-418a-ab3e-b0ef7b4a3da9 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:36.555737 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-07609fd2-bced-418a-ab3e-b0ef7b4a3da9 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:36.556490 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-07609fd2-bced-418a-ab3e-b0ef7b4a3da9 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:36.556916 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-07609fd2-bced-418a-ab3e-b0ef7b4a3da9 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:36.678015 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-07609fd2-bced-418a-ab3e-b0ef7b4a3da9 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:36.685838 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-07609fd2-bced-418a-ab3e-b0ef7b4a3da9 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1549 microversion: 2.1 time: 0.140914 Oct 13 04:21:36.686398 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 316/620] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:36 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1549 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:36.701421 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-29b11955-1e23-4f17-8b17-e2ca1d25658b tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:36.704811 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:21:36.704811 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:21:36.705826 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-29b11955-1e23-4f17-8b17-e2ca1d25658b tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:36.706569 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-29b11955-1e23-4f17-8b17-e2ca1d25658b tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Searching by: {'deleted': False, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c'} {{(pid=108259) get_all /opt/stack/nova/nova/compute/api.py:2905}} Oct 13 04:21:36.713421 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-29b11955-1e23-4f17-8b17-e2ca1d25658b tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:36.713886 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-29b11955-1e23-4f17-8b17-e2ca1d25658b tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:36.714682 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-29b11955-1e23-4f17-8b17-e2ca1d25658b tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:36.715232 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-29b11955-1e23-4f17-8b17-e2ca1d25658b tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:36.720125 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-bd637f90-67b0-420b-951c-d2d1f89652d5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:36.720724 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-bd637f90-67b0-420b-951c-d2d1f89652d5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:36.726983 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bd637f90-67b0-420b-951c-d2d1f89652d5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:36.727427 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bd637f90-67b0-420b-951c-d2d1f89652d5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:36.728178 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bd637f90-67b0-420b-951c-d2d1f89652d5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:36.728606 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bd637f90-67b0-420b-951c-d2d1f89652d5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:36.804757 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.multi_cell_list [None req-29b11955-1e23-4f17-8b17-e2ca1d25658b tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=108259) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Oct 13 04:21:36.879547 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-bd637f90-67b0-420b-951c-d2d1f89652d5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:36.886826 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-bd637f90-67b0-420b-951c-d2d1f89652d5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1515 microversion: 2.1 time: 0.170281 Oct 13 04:21:36.887456 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 317/621] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:36 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:36.901669 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-29b11955-1e23-4f17-8b17-e2ca1d25658b tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203772 Oct 13 04:21:36.902254 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 305/622] 10.222.0.55 () {58 vars in 1124 bytes} [Wed Oct 13 04:21:36 2021] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:36.912682 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3cb21cb3-11e5-4825-aeae-9d83bf3b24fc tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:36.913279 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3cb21cb3-11e5-4825-aeae-9d83bf3b24fc tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:36.919190 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3cb21cb3-11e5-4825-aeae-9d83bf3b24fc tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:36.919629 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3cb21cb3-11e5-4825-aeae-9d83bf3b24fc tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:36.920390 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3cb21cb3-11e5-4825-aeae-9d83bf3b24fc tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:36.920811 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3cb21cb3-11e5-4825-aeae-9d83bf3b24fc tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:37.118585 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-3cb21cb3-11e5-4825-aeae-9d83bf3b24fc tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:37.126291 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3cb21cb3-11e5-4825-aeae-9d83bf3b24fc tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1549 microversion: 2.1 time: 0.217685 Oct 13 04:21:37.126868 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 318/623] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:36 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1549 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:37.418892 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-d81a5110-e4aa-4b40-a998-5f0095a83cf7 req-87a476f5-508b-41f9-a555-1c304e4bbb46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91ac1af-2378-4b6f-9ca7-08181ffe7d44", "name": "network-vif-deleted", "tag": "0d108316-b79c-4ebf-af4e-9237f069cd94"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:37.418892 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:21:37.418892 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:21:37.419905 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-d81a5110-e4aa-4b40-a998-5f0095a83cf7 req-87a476f5-508b-41f9-a555-1c304e4bbb46 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:37.420383 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-d81a5110-e4aa-4b40-a998-5f0095a83cf7 req-87a476f5-508b-41f9-a555-1c304e4bbb46 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:37.441297 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-d81a5110-e4aa-4b40-a998-5f0095a83cf7 req-87a476f5-508b-41f9-a555-1c304e4bbb46 service nova] Creating event network-vif-deleted:0d108316-b79c-4ebf-af4e-9237f069cd94 for instance d91ac1af-2378-4b6f-9ca7-08181ffe7d44 on hv-cinder-81275 Oct 13 04:21:37.449314 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-d81a5110-e4aa-4b40-a998-5f0095a83cf7 req-87a476f5-508b-41f9-a555-1c304e4bbb46 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041973 Oct 13 04:21:37.452764 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 306/624] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:21:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:37.508053 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7316e54f-c6db-448e-8c62-7de251a16cc1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:37.509329 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7316e54f-c6db-448e-8c62-7de251a16cc1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:37.517632 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7316e54f-c6db-448e-8c62-7de251a16cc1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:37.518374 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7316e54f-c6db-448e-8c62-7de251a16cc1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:37.519525 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7316e54f-c6db-448e-8c62-7de251a16cc1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:37.520112 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7316e54f-c6db-448e-8c62-7de251a16cc1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:37.671407 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-7316e54f-c6db-448e-8c62-7de251a16cc1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:37.679373 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-7316e54f-c6db-448e-8c62-7de251a16cc1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:37.680861 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-7316e54f-c6db-448e-8c62-7de251a16cc1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:37.683287 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7316e54f-c6db-448e-8c62-7de251a16cc1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1721 microversion: 2.20 time: 0.179627 Oct 13 04:21:37.683969 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 319/625] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:37 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:37.903781 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-11d2ebdd-632d-4b0c-8314-9f7a376ccbf5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:37.904503 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-11d2ebdd-632d-4b0c-8314-9f7a376ccbf5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:37.911119 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-11d2ebdd-632d-4b0c-8314-9f7a376ccbf5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:37.911549 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-11d2ebdd-632d-4b0c-8314-9f7a376ccbf5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:37.912385 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-11d2ebdd-632d-4b0c-8314-9f7a376ccbf5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:37.912810 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-11d2ebdd-632d-4b0c-8314-9f7a376ccbf5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:37.946647 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-11d2ebdd-632d-4b0c-8314-9f7a376ccbf5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:37.947319 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-11d2ebdd-632d-4b0c-8314-9f7a376ccbf5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:37.947767 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-11d2ebdd-632d-4b0c-8314-9f7a376ccbf5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lazy-loading 'fault' on Instance uuid d91ac1af-2378-4b6f-9ca7-08181ffe7d44 {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:21:37.998303 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-11d2ebdd-632d-4b0c-8314-9f7a376ccbf5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3f110a789d432d85e185decef26aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6806325e2e94089a6944698ad9b7808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:38.005085 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-11d2ebdd-632d-4b0c-8314-9f7a376ccbf5 tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 200 len: 1308 microversion: 2.1 time: 0.105357 Oct 13 04:21:38.005669 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 307/626] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:37 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:38.082314 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5ad7e927-8712-4156-8752-ab40bf68480a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:38.088190 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5ad7e927-8712-4156-8752-ab40bf68480a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:38.088616 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5ad7e927-8712-4156-8752-ab40bf68480a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:38.147078 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5ad7e927-8712-4156-8752-ab40bf68480a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Going to try to stop instance {{(pid=108260) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 13 04:21:38.192148 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5ad7e927-8712-4156-8752-ab40bf68480a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 202 len: 0 microversion: 2.1 time: 0.113237 Oct 13 04:21:38.192820 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 320/627] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:21:38 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:21:38.200798 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-49022b7e-1886-465a-8d22-6fbfa3c6ba23 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:38.201401 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-49022b7e-1886-465a-8d22-6fbfa3c6ba23 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:38.208016 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-49022b7e-1886-465a-8d22-6fbfa3c6ba23 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:38.208555 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-49022b7e-1886-465a-8d22-6fbfa3c6ba23 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:38.209671 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-49022b7e-1886-465a-8d22-6fbfa3c6ba23 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:38.210454 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-49022b7e-1886-465a-8d22-6fbfa3c6ba23 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:38.345449 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-49022b7e-1886-465a-8d22-6fbfa3c6ba23 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:38.353161 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-49022b7e-1886-465a-8d22-6fbfa3c6ba23 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.156044 Oct 13 04:21:38.353838 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 308/628] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:38 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:38.702365 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6d0b9549-a803-4ac5-88d0-c4c1d76a647b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:38.703760 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6d0b9549-a803-4ac5-88d0-c4c1d76a647b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:38.710142 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6d0b9549-a803-4ac5-88d0-c4c1d76a647b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:38.710585 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6d0b9549-a803-4ac5-88d0-c4c1d76a647b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:38.711347 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6d0b9549-a803-4ac5-88d0-c4c1d76a647b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:38.711770 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6d0b9549-a803-4ac5-88d0-c4c1d76a647b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:38.729182 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c2911d59-d95e-4b36-930d-7549e6ab34be tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77641d26-0807-4902-a4fd-8c29c0d7b1d0"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:38.731000 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c2911d59-d95e-4b36-930d-7549e6ab34be tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:38.738242 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2911d59-d95e-4b36-930d-7549e6ab34be tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:38.739013 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2911d59-d95e-4b36-930d-7549e6ab34be tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:38.740174 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2911d59-d95e-4b36-930d-7549e6ab34be tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:38.740757 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2911d59-d95e-4b36-930d-7549e6ab34be tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:38.855888 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6d0b9549-a803-4ac5-88d0-c4c1d76a647b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:38.864180 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6d0b9549-a803-4ac5-88d0-c4c1d76a647b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:38.865780 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6d0b9549-a803-4ac5-88d0-c4c1d76a647b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:38.867061 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6d0b9549-a803-4ac5-88d0-c4c1d76a647b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1721 microversion: 2.20 time: 0.169022 Oct 13 04:21:38.867817 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 321/629] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:38 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:39.003445 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c2911d59-d95e-4b36-930d-7549e6ab34be tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "POST /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277679 Oct 13 04:21:39.004405 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 309/630] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Oct 13 04:21:38 2021] POST /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:21:39.022562 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a63891fb-a05e-4392-a5a0-44f8bd257b5c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:39.023502 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a63891fb-a05e-4392-a5a0-44f8bd257b5c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] [instance: d91ac1af-2378-4b6f-9ca7-08181ffe7d44] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:39.029880 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a63891fb-a05e-4392-a5a0-44f8bd257b5c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:39.030503 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a63891fb-a05e-4392-a5a0-44f8bd257b5c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:39.031757 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a63891fb-a05e-4392-a5a0-44f8bd257b5c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:39.032336 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a63891fb-a05e-4392-a5a0-44f8bd257b5c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:39.053589 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-a63891fb-a05e-4392-a5a0-44f8bd257b5c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] HTTP exception thrown: Instance d91ac1af-2378-4b6f-9ca7-08181ffe7d44 could not be found. Oct 13 04:21:39.054397 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a63891fb-a05e-4392-a5a0-44f8bd257b5c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] Returning 404 to user: Instance d91ac1af-2378-4b6f-9ca7-08181ffe7d44 could not be found. {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:21:39.055226 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a63891fb-a05e-4392-a5a0-44f8bd257b5c tempest-AttachVolumeNegativeTest-1547195177 tempest-AttachVolumeNegativeTest-1547195177-project] 10.222.0.55 "GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44" status: 404 len: 111 microversion: 2.1 time: 0.036784 Oct 13 04:21:39.059102 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 322/631] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:39 2021] GET /compute/v2.1/servers/d91ac1af-2378-4b6f-9ca7-08181ffe7d44 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:21:39.370897 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-98643c55-9cd8-49f3-884a-b81e951ad469 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:39.371623 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-98643c55-9cd8-49f3-884a-b81e951ad469 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:39.377774 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-98643c55-9cd8-49f3-884a-b81e951ad469 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:39.378253 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-98643c55-9cd8-49f3-884a-b81e951ad469 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:39.379013 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-98643c55-9cd8-49f3-884a-b81e951ad469 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:39.379426 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-98643c55-9cd8-49f3-884a-b81e951ad469 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:39.503860 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-98643c55-9cd8-49f3-884a-b81e951ad469 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:39.516946 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-98643c55-9cd8-49f3-884a-b81e951ad469 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.149918 Oct 13 04:21:39.517740 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 310/632] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:39 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:39.886368 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-cc21c188-ffce-4555-ba07-9253b5ada38b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:39.887036 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-cc21c188-ffce-4555-ba07-9253b5ada38b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:39.900315 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cc21c188-ffce-4555-ba07-9253b5ada38b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:39.901286 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cc21c188-ffce-4555-ba07-9253b5ada38b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:39.902044 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cc21c188-ffce-4555-ba07-9253b5ada38b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:39.902772 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cc21c188-ffce-4555-ba07-9253b5ada38b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:40.045985 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-cc21c188-ffce-4555-ba07-9253b5ada38b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:40.053574 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-cc21c188-ffce-4555-ba07-9253b5ada38b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:40.055055 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-cc21c188-ffce-4555-ba07-9253b5ada38b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:40.056186 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-cc21c188-ffce-4555-ba07-9253b5ada38b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1721 microversion: 2.20 time: 0.174288 Oct 13 04:21:40.056733 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 323/633] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:39 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:40.534394 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8ed955de-5215-4dfb-9110-ec2dc81d6246 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:40.535316 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-8ed955de-5215-4dfb-9110-ec2dc81d6246 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:40.541591 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8ed955de-5215-4dfb-9110-ec2dc81d6246 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:40.542063 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8ed955de-5215-4dfb-9110-ec2dc81d6246 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:40.542821 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8ed955de-5215-4dfb-9110-ec2dc81d6246 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:40.543245 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8ed955de-5215-4dfb-9110-ec2dc81d6246 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:40.663097 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-8ed955de-5215-4dfb-9110-ec2dc81d6246 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:40.673287 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-8ed955de-5215-4dfb-9110-ec2dc81d6246 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.142274 Oct 13 04:21:40.673961 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 311/634] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:40 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:40.764531 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-31191ab0-2bcc-49cd-bd23-494737be56f1 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Action: 'create', calling method: .version_select at 0x7f33f6edf550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-204019057"}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:41.052590 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-31191ab0-2bcc-49cd-bd23-494737be56f1 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.424297 Oct 13 04:21:41.053234 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 324/635] 10.222.0.55 () {60 vars in 1154 bytes} [Wed Oct 13 04:21:40 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 426 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 13 04:21:41.064307 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8b6874d1-1af9-407e-9169-84c3b5093cdf tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33f6cf7f70>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:41.074549 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-53724379-67fa-4237-b4db-dc3b034287aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:41.075369 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-53724379-67fa-4237-b4db-dc3b034287aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:41.086300 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-53724379-67fa-4237-b4db-dc3b034287aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:41.086731 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-53724379-67fa-4237-b4db-dc3b034287aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:41.087493 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-53724379-67fa-4237-b4db-dc3b034287aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:41.087911 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-53724379-67fa-4237-b4db-dc3b034287aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:41.127096 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-8b6874d1-1af9-407e-9169-84c3b5093cdf tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/836e300c-78e5-4d20-9331-fcf0cca82760" status: 200 len: 344 microversion: 2.1 time: 0.066164 Oct 13 04:21:41.127683 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 312/636] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Oct 13 04:21:41 2021] GET /compute/v2.1/os-volumes/836e300c-78e5-4d20-9331-fcf0cca82760 => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:21:41.214337 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-53724379-67fa-4237-b4db-dc3b034287aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:41.222188 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-53724379-67fa-4237-b4db-dc3b034287aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:41.223667 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-53724379-67fa-4237-b4db-dc3b034287aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:41.224816 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-53724379-67fa-4237-b4db-dc3b034287aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1721 microversion: 2.20 time: 0.154380 Oct 13 04:21:41.225376 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 325/637] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:41 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:41.691236 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-117cf9b6-235b-4e74-8611-a2500689e967 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:41.691819 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-117cf9b6-235b-4e74-8611-a2500689e967 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:41.698744 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-117cf9b6-235b-4e74-8611-a2500689e967 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:41.699276 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-117cf9b6-235b-4e74-8611-a2500689e967 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:41.700053 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-117cf9b6-235b-4e74-8611-a2500689e967 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:41.700480 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-117cf9b6-235b-4e74-8611-a2500689e967 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:42.001979 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-117cf9b6-235b-4e74-8611-a2500689e967 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:42.010056 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-117cf9b6-235b-4e74-8611-a2500689e967 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.322576 Oct 13 04:21:42.010710 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 313/638] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:41 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:42.139551 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ecf9e61e-a1da-4987-9e12-0cf0eec041fe tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33fc0365e0>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:42.194132 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ecf9e61e-a1da-4987-9e12-0cf0eec041fe tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/836e300c-78e5-4d20-9331-fcf0cca82760" status: 200 len: 345 microversion: 2.1 time: 0.058362 Oct 13 04:21:42.202937 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 326/639] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Oct 13 04:21:42 2021] GET /compute/v2.1/os-volumes/836e300c-78e5-4d20-9331-fcf0cca82760 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:42.207453 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-bca7d8e7-559f-432f-99a1-ddaf87890f3a tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Action: 'create', calling method: .version_select at 0x7f33f6c2e670>, body: {"snapshot": {"volume_id": "836e300c-78e5-4d20-9331-fcf0cca82760", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-197493591"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:42.243835 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-05245504-52ac-47d1-a379-5c88a3758d16 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:42.245172 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-05245504-52ac-47d1-a379-5c88a3758d16 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:42.252629 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-05245504-52ac-47d1-a379-5c88a3758d16 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:42.253525 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-05245504-52ac-47d1-a379-5c88a3758d16 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:42.254759 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-05245504-52ac-47d1-a379-5c88a3758d16 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:42.255257 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-05245504-52ac-47d1-a379-5c88a3758d16 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:42.370961 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-bca7d8e7-559f-432f-99a1-ddaf87890f3a tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.167284 Oct 13 04:21:42.376955 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 314/640] 10.222.0.55 () {60 vars in 1161 bytes} [Wed Oct 13 04:21:42 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:42.382519 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a76b58f4-834b-4ff4-806e-ec2f6cce8787 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33f6b9b820>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:42.386576 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-05245504-52ac-47d1-a379-5c88a3758d16 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:42.395499 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-05245504-52ac-47d1-a379-5c88a3758d16 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:42.397334 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-05245504-52ac-47d1-a379-5c88a3758d16 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:42.398721 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-05245504-52ac-47d1-a379-5c88a3758d16 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1721 microversion: 2.20 time: 0.159286 Oct 13 04:21:42.399270 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 327/641] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:42 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:42.413127 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a76b58f4-834b-4ff4-806e-ec2f6cce8787 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda" status: 200 len: 286 microversion: 2.1 time: 0.035072 Oct 13 04:21:42.413793 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 315/642] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Oct 13 04:21:42 2021] GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:42.424267 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1ac00c38-f7a0-4c8a-86f4-ea2dcead917c tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33f6de1b80>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:42.452868 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-1ac00c38-f7a0-4c8a-86f4-ea2dcead917c tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032713 Oct 13 04:21:42.453425 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 328/643] 10.222.0.55 () {58 vars in 1139 bytes} [Wed Oct 13 04:21:42 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:42.463640 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2e1e71e4-a72c-49b2-b55a-529df11f020e tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33f6c2e430>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:42.494978 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2e1e71e4-a72c-49b2-b55a-529df11f020e tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda" status: 200 len: 286 microversion: 2.1 time: 0.035097 Oct 13 04:21:42.495518 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 316/644] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Oct 13 04:21:42 2021] GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:21:43.027551 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-071bb2af-e0d4-4553-aab7-436638ed1667 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:43.028118 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-071bb2af-e0d4-4553-aab7-436638ed1667 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:43.034462 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-071bb2af-e0d4-4553-aab7-436638ed1667 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:43.035246 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-071bb2af-e0d4-4553-aab7-436638ed1667 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:43.035997 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-071bb2af-e0d4-4553-aab7-436638ed1667 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:43.036419 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-071bb2af-e0d4-4553-aab7-436638ed1667 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:43.160732 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-071bb2af-e0d4-4553-aab7-436638ed1667 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:43.168891 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-071bb2af-e0d4-4553-aab7-436638ed1667 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.145359 Oct 13 04:21:43.169542 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 329/645] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:43 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:43.416999 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-631d1177-b7b3-4760-9c76-b2494c5bc643 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:43.417592 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-631d1177-b7b3-4760-9c76-b2494c5bc643 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:43.424139 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-631d1177-b7b3-4760-9c76-b2494c5bc643 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:43.424732 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-631d1177-b7b3-4760-9c76-b2494c5bc643 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:43.425656 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-631d1177-b7b3-4760-9c76-b2494c5bc643 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:43.426169 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-631d1177-b7b3-4760-9c76-b2494c5bc643 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:43.507452 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5712455d-23a8-4eda-ad07-83acbb08fbb0 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33f6ef48b0>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:43.539369 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5712455d-23a8-4eda-ad07-83acbb08fbb0 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda" status: 200 len: 286 microversion: 2.1 time: 0.035491 Oct 13 04:21:43.540458 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 330/646] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Oct 13 04:21:43 2021] GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:21:43.559568 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-631d1177-b7b3-4760-9c76-b2494c5bc643 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:43.567335 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-631d1177-b7b3-4760-9c76-b2494c5bc643 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:43.568813 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-631d1177-b7b3-4760-9c76-b2494c5bc643 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:43.570017 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-631d1177-b7b3-4760-9c76-b2494c5bc643 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1721 microversion: 2.20 time: 0.157284 Oct 13 04:21:43.570575 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 317/647] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:43 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:44.185965 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-32489564-5539-48c4-8316-ae08c0650262 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:44.186638 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-32489564-5539-48c4-8316-ae08c0650262 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:44.193182 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-32489564-5539-48c4-8316-ae08c0650262 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:44.193636 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-32489564-5539-48c4-8316-ae08c0650262 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:44.194439 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-32489564-5539-48c4-8316-ae08c0650262 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:44.194872 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-32489564-5539-48c4-8316-ae08c0650262 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:44.317497 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-32489564-5539-48c4-8316-ae08c0650262 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:44.325323 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-32489564-5539-48c4-8316-ae08c0650262 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.143355 Oct 13 04:21:44.325903 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 331/648] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:44 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:44.552991 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-673dc8a9-889b-4520-86a9-9eef4a510726 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33f6c2e280>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:44.588057 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5c97077a-7fa4-4090-a3f0-631a6b3f8bde tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:44.588659 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5c97077a-7fa4-4090-a3f0-631a6b3f8bde tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:44.589196 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-673dc8a9-889b-4520-86a9-9eef4a510726 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda" status: 200 len: 286 microversion: 2.1 time: 0.041078 Oct 13 04:21:44.590119 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 318/649] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Oct 13 04:21:44 2021] GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:44.598488 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5c97077a-7fa4-4090-a3f0-631a6b3f8bde tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:44.598926 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5c97077a-7fa4-4090-a3f0-631a6b3f8bde tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:44.599674 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5c97077a-7fa4-4090-a3f0-631a6b3f8bde tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:44.600094 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5c97077a-7fa4-4090-a3f0-631a6b3f8bde tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:44.724855 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5c97077a-7fa4-4090-a3f0-631a6b3f8bde tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:44.732598 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5c97077a-7fa4-4090-a3f0-631a6b3f8bde tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:44.734097 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5c97077a-7fa4-4090-a3f0-631a6b3f8bde tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:44.735243 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5c97077a-7fa4-4090-a3f0-631a6b3f8bde tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1721 microversion: 2.20 time: 0.151074 Oct 13 04:21:44.735800 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 332/650] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:44 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:45.346199 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-19911b7a-eb34-494c-8c59-9edda398ea12 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:45.347105 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-19911b7a-eb34-494c-8c59-9edda398ea12 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:45.356971 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-19911b7a-eb34-494c-8c59-9edda398ea12 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:45.357193 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-19911b7a-eb34-494c-8c59-9edda398ea12 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:45.358335 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-19911b7a-eb34-494c-8c59-9edda398ea12 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:45.359048 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-19911b7a-eb34-494c-8c59-9edda398ea12 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:45.492138 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-19911b7a-eb34-494c-8c59-9edda398ea12 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:45.500319 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-19911b7a-eb34-494c-8c59-9edda398ea12 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.160375 Oct 13 04:21:45.500863 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 319/651] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:45 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:45.605417 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-63e53682-4c65-4397-92cb-22b7198371be tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33f6d73f70>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:45.640137 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-63e53682-4c65-4397-92cb-22b7198371be tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda" status: 200 len: 286 microversion: 2.1 time: 0.041169 Oct 13 04:21:45.640689 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 333/652] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Oct 13 04:21:45 2021] GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:45.756993 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3bfb3518-833e-4668-8d4f-426265b2c3cd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:45.758165 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3bfb3518-833e-4668-8d4f-426265b2c3cd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:45.771108 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3bfb3518-833e-4668-8d4f-426265b2c3cd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:45.775631 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3bfb3518-833e-4668-8d4f-426265b2c3cd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:45.776907 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3bfb3518-833e-4668-8d4f-426265b2c3cd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:45.777507 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3bfb3518-833e-4668-8d4f-426265b2c3cd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:45.897325 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-3bfb3518-833e-4668-8d4f-426265b2c3cd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:45.906014 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-3bfb3518-833e-4668-8d4f-426265b2c3cd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:45.907490 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-3bfb3518-833e-4668-8d4f-426265b2c3cd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:45.908636 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3bfb3518-833e-4668-8d4f-426265b2c3cd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1721 microversion: 2.20 time: 0.157800 Oct 13 04:21:45.909168 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 320/653] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:45 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:46.521229 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d422ac8b-8a2f-4610-80c9-991c7f9d2464 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:46.522267 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d422ac8b-8a2f-4610-80c9-991c7f9d2464 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:46.530898 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d422ac8b-8a2f-4610-80c9-991c7f9d2464 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:46.531335 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d422ac8b-8a2f-4610-80c9-991c7f9d2464 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:46.532087 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d422ac8b-8a2f-4610-80c9-991c7f9d2464 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:46.532509 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d422ac8b-8a2f-4610-80c9-991c7f9d2464 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:46.652051 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3a5ad35e-24ed-4afc-896a-644a5e20f68e tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33f6cf70d0>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:46.664155 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d422ac8b-8a2f-4610-80c9-991c7f9d2464 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:46.671960 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d422ac8b-8a2f-4610-80c9-991c7f9d2464 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.156945 Oct 13 04:21:46.672549 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 334/654] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:46 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:46.684617 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3a5ad35e-24ed-4afc-896a-644a5e20f68e tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda" status: 200 len: 286 microversion: 2.1 time: 0.036024 Oct 13 04:21:46.685288 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 321/655] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Oct 13 04:21:46 2021] GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:46.934767 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-948aabe7-9e4b-484c-be41-261d4bed27d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:46.935620 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-948aabe7-9e4b-484c-be41-261d4bed27d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:46.945886 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-948aabe7-9e4b-484c-be41-261d4bed27d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:46.946622 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-948aabe7-9e4b-484c-be41-261d4bed27d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:46.947874 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-948aabe7-9e4b-484c-be41-261d4bed27d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:46.948581 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-948aabe7-9e4b-484c-be41-261d4bed27d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:47.079586 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-948aabe7-9e4b-484c-be41-261d4bed27d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:47.087541 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-948aabe7-9e4b-484c-be41-261d4bed27d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:47.089013 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-948aabe7-9e4b-484c-be41-261d4bed27d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:47.090194 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-948aabe7-9e4b-484c-be41-261d4bed27d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1721 microversion: 2.20 time: 0.161816 Oct 13 04:21:47.090785 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 335/656] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:46 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:47.701314 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-6cd37b19-ac9a-4f9b-be1d-0926d21c8292 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33f6c2e160>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:47.724090 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-941670d9-25c5-473b-a984-ffcbbf7f2d37 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:47.724795 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-941670d9-25c5-473b-a984-ffcbbf7f2d37 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:47.733506 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-941670d9-25c5-473b-a984-ffcbbf7f2d37 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:47.734009 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-941670d9-25c5-473b-a984-ffcbbf7f2d37 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:47.735073 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-6cd37b19-ac9a-4f9b-be1d-0926d21c8292 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda" status: 200 len: 287 microversion: 2.1 time: 0.040582 Oct 13 04:21:47.735760 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 322/657] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Oct 13 04:21:47 2021] GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:47.735894 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-941670d9-25c5-473b-a984-ffcbbf7f2d37 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:47.736478 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-941670d9-25c5-473b-a984-ffcbbf7f2d37 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:47.745991 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ef5b4686-5d70-4712-887f-f61359a9ac3d tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33f6bb0280>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:47.807055 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ef5b4686-5d70-4712-887f-f61359a9ac3d tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "DELETE /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda" status: 202 len: 0 microversion: 2.1 time: 0.062876 Oct 13 04:21:47.807055 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 323/658] 10.222.0.55 () {58 vars in 1253 bytes} [Wed Oct 13 04:21:47 2021] DELETE /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:21:47.813756 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-27e08c7a-ee8b-44cc-b495-bdcf7c35bf50 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33f6cf74c0>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:47.844706 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-27e08c7a-ee8b-44cc-b495-bdcf7c35bf50 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda" status: 200 len: 286 microversion: 2.1 time: 0.034570 Oct 13 04:21:47.845244 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 324/659] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Oct 13 04:21:47 2021] GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:21:47.890050 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-941670d9-25c5-473b-a984-ffcbbf7f2d37 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:47.898387 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-941670d9-25c5-473b-a984-ffcbbf7f2d37 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.178654 Oct 13 04:21:47.898961 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 336/660] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:47 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:48.108578 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-edafec38-4c8a-4fc2-84e1-e7a9719e50ba tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:48.108980 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-edafec38-4c8a-4fc2-84e1-e7a9719e50ba tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:48.114840 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-edafec38-4c8a-4fc2-84e1-e7a9719e50ba tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:48.115280 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-edafec38-4c8a-4fc2-84e1-e7a9719e50ba tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:48.116040 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-edafec38-4c8a-4fc2-84e1-e7a9719e50ba tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:48.116459 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-edafec38-4c8a-4fc2-84e1-e7a9719e50ba tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:48.247684 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-edafec38-4c8a-4fc2-84e1-e7a9719e50ba tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:48.256908 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-edafec38-4c8a-4fc2-84e1-e7a9719e50ba tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:48.258457 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-edafec38-4c8a-4fc2-84e1-e7a9719e50ba tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:48.259611 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-edafec38-4c8a-4fc2-84e1-e7a9719e50ba tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1742 microversion: 2.20 time: 0.155098 Oct 13 04:21:48.260170 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 325/661] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:48 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:48.856393 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-46b0bc86-7a07-4a52-9646-81428db88f20 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33f6d3c040>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:48.880893 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-46b0bc86-7a07-4a52-9646-81428db88f20 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] HTTP exception thrown: Snapshot f4be9ea6-873d-4b9c-b918-016fbdb05cda could not be found. Oct 13 04:21:48.881466 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-46b0bc86-7a07-4a52-9646-81428db88f20 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Returning 404 to user: Snapshot f4be9ea6-873d-4b9c-b918-016fbdb05cda could not be found. {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:21:48.882324 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-46b0bc86-7a07-4a52-9646-81428db88f20 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda" status: 404 len: 111 microversion: 2.1 time: 0.029732 Oct 13 04:21:48.882831 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 337/662] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Oct 13 04:21:48 2021] GET /compute/v2.1/os-snapshots/f4be9ea6-873d-4b9c-b918-016fbdb05cda => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:21:48.891082 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-6f19ff86-ebe1-43f4-85af-7a582eadaff0 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33f6c2ea60>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:48.915740 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-99df08ef-187a-4fb5-aa51-aa8dde65aa69 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:48.917253 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-99df08ef-187a-4fb5-aa51-aa8dde65aa69 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:48.923809 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-99df08ef-187a-4fb5-aa51-aa8dde65aa69 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:48.924260 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-99df08ef-187a-4fb5-aa51-aa8dde65aa69 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:48.925411 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-99df08ef-187a-4fb5-aa51-aa8dde65aa69 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:48.925873 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-99df08ef-187a-4fb5-aa51-aa8dde65aa69 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:48.951990 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-6f19ff86-ebe1-43f4-85af-7a582eadaff0 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/836e300c-78e5-4d20-9331-fcf0cca82760" status: 202 len: 0 microversion: 2.1 time: 0.064671 Oct 13 04:21:48.952604 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 326/663] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Oct 13 04:21:48 2021] DELETE /compute/v2.1/os-volumes/836e300c-78e5-4d20-9331-fcf0cca82760 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:21:48.960274 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-edf67511-54cf-4ec1-96d8-05b967d327ef tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33f6c87a60>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:49.007224 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-edf67511-54cf-4ec1-96d8-05b967d327ef tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/836e300c-78e5-4d20-9331-fcf0cca82760" status: 200 len: 344 microversion: 2.1 time: 0.050266 Oct 13 04:21:49.007792 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 327/664] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Oct 13 04:21:48 2021] GET /compute/v2.1/os-volumes/836e300c-78e5-4d20-9331-fcf0cca82760 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:49.051798 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-99df08ef-187a-4fb5-aa51-aa8dde65aa69 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:49.059606 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-99df08ef-187a-4fb5-aa51-aa8dde65aa69 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.147811 Oct 13 04:21:49.060196 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 338/665] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:48 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:49.284428 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4bbc412b-3d9d-4bb6-92be-9e526a748d4f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:49.285183 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4bbc412b-3d9d-4bb6-92be-9e526a748d4f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:49.291755 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4bbc412b-3d9d-4bb6-92be-9e526a748d4f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:49.292190 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4bbc412b-3d9d-4bb6-92be-9e526a748d4f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:49.292942 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4bbc412b-3d9d-4bb6-92be-9e526a748d4f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:49.293358 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4bbc412b-3d9d-4bb6-92be-9e526a748d4f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:49.387260 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-8a361f28-d6b3-4276-9edf-43b24532c5cd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:49.388258 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-8a361f28-d6b3-4276-9edf-43b24532c5cd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:49.394575 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8a361f28-d6b3-4276-9edf-43b24532c5cd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:49.395019 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8a361f28-d6b3-4276-9edf-43b24532c5cd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:49.395784 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8a361f28-d6b3-4276-9edf-43b24532c5cd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:49.396200 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8a361f28-d6b3-4276-9edf-43b24532c5cd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:49.421226 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-4bbc412b-3d9d-4bb6-92be-9e526a748d4f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:49.421399 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.objects.instance [None req-8a361f28-d6b3-4276-9edf-43b24532c5cd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lazy-loading 'flavor' on Instance uuid 2b4223c8-bfe1-440e-89bc-7158a1490e1c {{(pid=108260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:21:49.429323 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-4bbc412b-3d9d-4bb6-92be-9e526a748d4f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:49.431024 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-4bbc412b-3d9d-4bb6-92be-9e526a748d4f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:49.432186 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4bbc412b-3d9d-4bb6-92be-9e526a748d4f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1742 microversion: 2.20 time: 0.151730 Oct 13 04:21:49.433068 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 328/666] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:49 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:49.482015 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-9d18bc5a-32dd-468a-86ba-b72fd4d8c587 req-db0441da-6aa1-4173-bfa2-a31e3778a9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c2b8a8f-db02-4581-b497-1f4caa68240f", "name": "network-vif-plugged", "status": "completed", "tag": "819b5060-2257-431d-a719-93e3e23c273c"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:49.483522 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:21:49.483522 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:21:49.490960 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-9d18bc5a-32dd-468a-86ba-b72fd4d8c587 req-db0441da-6aa1-4173-bfa2-a31e3778a9f5 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:49.491943 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-9d18bc5a-32dd-468a-86ba-b72fd4d8c587 req-db0441da-6aa1-4173-bfa2-a31e3778a9f5 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:49.503054 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-9d18bc5a-32dd-468a-86ba-b72fd4d8c587 req-db0441da-6aa1-4173-bfa2-a31e3778a9f5 service nova] Creating event network-vif-plugged:819b5060-2257-431d-a719-93e3e23c273c for instance 3c2b8a8f-db02-4581-b497-1f4caa68240f on hv-cinder-81275 Oct 13 04:21:49.508373 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-9d18bc5a-32dd-468a-86ba-b72fd4d8c587 req-db0441da-6aa1-4173-bfa2-a31e3778a9f5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029992 Oct 13 04:21:49.513755 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 329/667] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:21:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:49.594290 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-8a361f28-d6b3-4276-9edf-43b24532c5cd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "POST /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/action" status: 200 len: 32 microversion: 2.1 time: 0.210946 Oct 13 04:21:49.595069 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 339/668] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:21:49 2021] POST /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/action => generated 32 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:21:49.605434 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3654e924-607a-45fe-9cb4-448ae7665252 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:49.606176 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3654e924-607a-45fe-9cb4-448ae7665252 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:49.613918 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3654e924-607a-45fe-9cb4-448ae7665252 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:49.614423 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3654e924-607a-45fe-9cb4-448ae7665252 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:49.615331 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3654e924-607a-45fe-9cb4-448ae7665252 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:49.615765 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3654e924-607a-45fe-9cb4-448ae7665252 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:49.803012 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-3654e924-607a-45fe-9cb4-448ae7665252 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:49.811507 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3654e924-607a-45fe-9cb4-448ae7665252 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.210242 Oct 13 04:21:49.812219 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 330/669] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:49 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:50.021258 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ce59f494-5815-4661-a670-d8ada5e20d21 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33f6edf4c0>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:50.049752 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-ce59f494-5815-4661-a670-d8ada5e20d21 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] HTTP exception thrown: Volume 836e300c-78e5-4d20-9331-fcf0cca82760 could not be found. Oct 13 04:21:50.050343 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ce59f494-5815-4661-a670-d8ada5e20d21 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Returning 404 to user: Volume 836e300c-78e5-4d20-9331-fcf0cca82760 could not be found. {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:21:50.051210 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ce59f494-5815-4661-a670-d8ada5e20d21 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/836e300c-78e5-4d20-9331-fcf0cca82760" status: 404 len: 109 microversion: 2.1 time: 0.034797 Oct 13 04:21:50.051891 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 340/670] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Oct 13 04:21:50 2021] GET /compute/v2.1/os-volumes/836e300c-78e5-4d20-9331-fcf0cca82760 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:21:50.066428 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a40dc378-b175-4f6a-b424-b140bf407317 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33f6d61a60>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:50.080701 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d510fd57-b148-4b1e-a6e1-7f2a984406e0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:50.082076 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d510fd57-b148-4b1e-a6e1-7f2a984406e0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:50.088454 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d510fd57-b148-4b1e-a6e1-7f2a984406e0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:50.088884 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d510fd57-b148-4b1e-a6e1-7f2a984406e0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:50.089823 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d510fd57-b148-4b1e-a6e1-7f2a984406e0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:50.090349 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d510fd57-b148-4b1e-a6e1-7f2a984406e0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:50.097282 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-a40dc378-b175-4f6a-b424-b140bf407317 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] HTTP exception thrown: Volume 836e300c-78e5-4d20-9331-fcf0cca82760 could not be found. Oct 13 04:21:50.098171 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a40dc378-b175-4f6a-b424-b140bf407317 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Returning 404 to user: Volume 836e300c-78e5-4d20-9331-fcf0cca82760 could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:21:50.099574 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a40dc378-b175-4f6a-b424-b140bf407317 tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/836e300c-78e5-4d20-9331-fcf0cca82760" status: 404 len: 109 microversion: 2.1 time: 0.036696 Oct 13 04:21:50.100527 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 331/671] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Oct 13 04:21:50 2021] DELETE /compute/v2.1/os-volumes/836e300c-78e5-4d20-9331-fcf0cca82760 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:21:50.109755 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-847d92b0-2f1a-4d85-8dfa-6cb171ffbd0a tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Calling method '.version_select at 0x7f33fd43e8b0>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:50.138043 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-847d92b0-2f1a-4d85-8dfa-6cb171ffbd0a tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] HTTP exception thrown: Volume 836e300c-78e5-4d20-9331-fcf0cca82760 could not be found. Oct 13 04:21:50.138641 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-847d92b0-2f1a-4d85-8dfa-6cb171ffbd0a tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] Returning 404 to user: Volume 836e300c-78e5-4d20-9331-fcf0cca82760 could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:21:50.139481 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-847d92b0-2f1a-4d85-8dfa-6cb171ffbd0a tempest-VolumesSnapshotsTestJSON-1131935231 tempest-VolumesSnapshotsTestJSON-1131935231-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/836e300c-78e5-4d20-9331-fcf0cca82760" status: 404 len: 109 microversion: 2.1 time: 0.034652 Oct 13 04:21:50.140037 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 332/672] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Oct 13 04:21:50 2021] GET /compute/v2.1/os-volumes/836e300c-78e5-4d20-9331-fcf0cca82760 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:21:50.246247 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d510fd57-b148-4b1e-a6e1-7f2a984406e0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:50.255300 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d510fd57-b148-4b1e-a6e1-7f2a984406e0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.179465 Oct 13 04:21:50.255938 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 341/673] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:50 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:50.450638 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3bc456e0-c7f2-4ab2-8e7d-1015a08bfa6a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:50.451235 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3bc456e0-c7f2-4ab2-8e7d-1015a08bfa6a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:50.457452 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3bc456e0-c7f2-4ab2-8e7d-1015a08bfa6a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:50.457928 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3bc456e0-c7f2-4ab2-8e7d-1015a08bfa6a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:50.458681 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3bc456e0-c7f2-4ab2-8e7d-1015a08bfa6a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:50.459090 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3bc456e0-c7f2-4ab2-8e7d-1015a08bfa6a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:50.586730 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-3bc456e0-c7f2-4ab2-8e7d-1015a08bfa6a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:50.595258 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-3bc456e0-c7f2-4ab2-8e7d-1015a08bfa6a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:50.596751 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-3bc456e0-c7f2-4ab2-8e7d-1015a08bfa6a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:50.597999 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3bc456e0-c7f2-4ab2-8e7d-1015a08bfa6a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1742 microversion: 2.20 time: 0.151053 Oct 13 04:21:50.598543 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 333/674] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:50 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1742 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:50.828158 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b221dd80-6b60-41bb-8907-4e64cdad3abf tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:50.828779 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b221dd80-6b60-41bb-8907-4e64cdad3abf tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:50.834801 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b221dd80-6b60-41bb-8907-4e64cdad3abf tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:50.835184 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b221dd80-6b60-41bb-8907-4e64cdad3abf tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:50.835936 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b221dd80-6b60-41bb-8907-4e64cdad3abf tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:50.836358 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b221dd80-6b60-41bb-8907-4e64cdad3abf tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:50.955847 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b221dd80-6b60-41bb-8907-4e64cdad3abf tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:50.964172 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b221dd80-6b60-41bb-8907-4e64cdad3abf tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.139705 Oct 13 04:21:50.964728 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 342/675] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:50 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:51.272091 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b08643dd-f3f4-4217-854c-a33d61ada77e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:51.272686 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b08643dd-f3f4-4217-854c-a33d61ada77e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:51.278584 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b08643dd-f3f4-4217-854c-a33d61ada77e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:51.279013 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b08643dd-f3f4-4217-854c-a33d61ada77e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:51.279842 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b08643dd-f3f4-4217-854c-a33d61ada77e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:51.280182 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b08643dd-f3f4-4217-854c-a33d61ada77e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:51.406056 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b08643dd-f3f4-4217-854c-a33d61ada77e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:51.414406 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b08643dd-f3f4-4217-854c-a33d61ada77e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.145927 Oct 13 04:21:51.414981 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 334/676] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:51 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:51.616445 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3bb3af55-b6d4-4588-bfee-7d5cbb3e8436 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:51.616993 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3bb3af55-b6d4-4588-bfee-7d5cbb3e8436 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:51.623109 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3bb3af55-b6d4-4588-bfee-7d5cbb3e8436 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:51.623554 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3bb3af55-b6d4-4588-bfee-7d5cbb3e8436 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:51.624315 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3bb3af55-b6d4-4588-bfee-7d5cbb3e8436 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:51.625027 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3bb3af55-b6d4-4588-bfee-7d5cbb3e8436 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:51.755438 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-3bb3af55-b6d4-4588-bfee-7d5cbb3e8436 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:51.764676 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-3bb3af55-b6d4-4588-bfee-7d5cbb3e8436 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:51.766198 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-3bb3af55-b6d4-4588-bfee-7d5cbb3e8436 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:51.767344 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3bb3af55-b6d4-4588-bfee-7d5cbb3e8436 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1742 microversion: 2.20 time: 0.154721 Oct 13 04:21:51.767893 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 343/677] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:51 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:51.981167 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f98983a6-c804-4386-8b4c-a460865d082d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:51.981882 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f98983a6-c804-4386-8b4c-a460865d082d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:51.987997 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f98983a6-c804-4386-8b4c-a460865d082d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:51.988713 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f98983a6-c804-4386-8b4c-a460865d082d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:51.989748 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f98983a6-c804-4386-8b4c-a460865d082d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:51.990365 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f98983a6-c804-4386-8b4c-a460865d082d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:52.114755 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f98983a6-c804-4386-8b4c-a460865d082d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:52.124904 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f98983a6-c804-4386-8b4c-a460865d082d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.147320 Oct 13 04:21:52.126649 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 335/678] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:51 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:52.433951 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-23f39f90-04de-4a21-ba9c-fac216cfc6f9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:52.434471 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-23f39f90-04de-4a21-ba9c-fac216cfc6f9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:52.441206 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-23f39f90-04de-4a21-ba9c-fac216cfc6f9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:52.441683 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-23f39f90-04de-4a21-ba9c-fac216cfc6f9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:52.442448 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-23f39f90-04de-4a21-ba9c-fac216cfc6f9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:52.442882 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-23f39f90-04de-4a21-ba9c-fac216cfc6f9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:52.570162 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-23f39f90-04de-4a21-ba9c-fac216cfc6f9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:52.580139 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-23f39f90-04de-4a21-ba9c-fac216cfc6f9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.150677 Oct 13 04:21:52.581341 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 344/679] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:52 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:52.824086 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d0dcdbb6-e313-4b9c-8b44-b7c40bb3ac1d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:52.824695 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d0dcdbb6-e313-4b9c-8b44-b7c40bb3ac1d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:52.830465 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0dcdbb6-e313-4b9c-8b44-b7c40bb3ac1d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:52.830910 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0dcdbb6-e313-4b9c-8b44-b7c40bb3ac1d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:52.831664 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0dcdbb6-e313-4b9c-8b44-b7c40bb3ac1d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:52.832085 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0dcdbb6-e313-4b9c-8b44-b7c40bb3ac1d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:52.955315 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-d0dcdbb6-e313-4b9c-8b44-b7c40bb3ac1d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:52.963281 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-d0dcdbb6-e313-4b9c-8b44-b7c40bb3ac1d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:52.964730 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-d0dcdbb6-e313-4b9c-8b44-b7c40bb3ac1d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:52.965897 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d0dcdbb6-e313-4b9c-8b44-b7c40bb3ac1d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1742 microversion: 2.20 time: 0.145526 Oct 13 04:21:52.966480 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 336/680] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:52 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1742 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:53.142947 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1cc7aa10-21b6-4c5f-a7ac-cc919d2e7cfe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:53.143534 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-1cc7aa10-21b6-4c5f-a7ac-cc919d2e7cfe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:53.149504 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1cc7aa10-21b6-4c5f-a7ac-cc919d2e7cfe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:53.149963 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1cc7aa10-21b6-4c5f-a7ac-cc919d2e7cfe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:53.150728 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1cc7aa10-21b6-4c5f-a7ac-cc919d2e7cfe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:53.151159 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1cc7aa10-21b6-4c5f-a7ac-cc919d2e7cfe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:53.294116 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-1cc7aa10-21b6-4c5f-a7ac-cc919d2e7cfe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:53.302287 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-1cc7aa10-21b6-4c5f-a7ac-cc919d2e7cfe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.163119 Oct 13 04:21:53.302933 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 345/681] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:53 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:53.597977 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-9d248e11-ef2f-4d5f-a02b-580debe56184 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:53.598665 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-9d248e11-ef2f-4d5f-a02b-580debe56184 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:53.604400 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9d248e11-ef2f-4d5f-a02b-580debe56184 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:53.604846 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9d248e11-ef2f-4d5f-a02b-580debe56184 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:53.605620 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9d248e11-ef2f-4d5f-a02b-580debe56184 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:53.606062 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9d248e11-ef2f-4d5f-a02b-580debe56184 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:53.779712 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-9d248e11-ef2f-4d5f-a02b-580debe56184 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:53.789765 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-9d248e11-ef2f-4d5f-a02b-580debe56184 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.195844 Oct 13 04:21:53.790304 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 337/682] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:53 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:53.983983 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-08d279af-8548-4d06-ab6d-6df6494a3c5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:53.984624 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-08d279af-8548-4d06-ab6d-6df6494a3c5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:53.995294 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-08d279af-8548-4d06-ab6d-6df6494a3c5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:53.995739 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-08d279af-8548-4d06-ab6d-6df6494a3c5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:53.996519 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-08d279af-8548-4d06-ab6d-6df6494a3c5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:53.997236 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-08d279af-8548-4d06-ab6d-6df6494a3c5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:54.120402 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-08d279af-8548-4d06-ab6d-6df6494a3c5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:54.128385 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-08d279af-8548-4d06-ab6d-6df6494a3c5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:54.129979 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-08d279af-8548-4d06-ab6d-6df6494a3c5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:54.131005 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-08d279af-8548-4d06-ab6d-6df6494a3c5a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1742 microversion: 2.20 time: 0.150718 Oct 13 04:21:54.131550 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 346/683] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:53 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1742 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:54.318590 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1dd160e1-6676-458d-bbce-133f3e7c49d8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:54.319178 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1dd160e1-6676-458d-bbce-133f3e7c49d8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:54.325427 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1dd160e1-6676-458d-bbce-133f3e7c49d8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:54.325958 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1dd160e1-6676-458d-bbce-133f3e7c49d8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:54.326832 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1dd160e1-6676-458d-bbce-133f3e7c49d8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:54.327136 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1dd160e1-6676-458d-bbce-133f3e7c49d8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:54.456146 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1dd160e1-6676-458d-bbce-133f3e7c49d8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:54.463758 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1dd160e1-6676-458d-bbce-133f3e7c49d8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.148811 Oct 13 04:21:54.464514 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 338/684] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:54 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:54.806617 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d8740a40-fb00-4d24-a701-f98dd25e50b4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:54.807217 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d8740a40-fb00-4d24-a701-f98dd25e50b4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:54.813171 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d8740a40-fb00-4d24-a701-f98dd25e50b4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:54.813663 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d8740a40-fb00-4d24-a701-f98dd25e50b4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:54.814381 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d8740a40-fb00-4d24-a701-f98dd25e50b4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:54.814805 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d8740a40-fb00-4d24-a701-f98dd25e50b4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:54.958910 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d8740a40-fb00-4d24-a701-f98dd25e50b4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:54.966701 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d8740a40-fb00-4d24-a701-f98dd25e50b4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.163866 Oct 13 04:21:54.976465 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 347/685] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:54 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:55.149713 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-77419852-b49d-4ffe-bc7f-d73e4c6f5e56 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:55.150321 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-77419852-b49d-4ffe-bc7f-d73e4c6f5e56 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:55.156342 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-77419852-b49d-4ffe-bc7f-d73e4c6f5e56 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:55.156787 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-77419852-b49d-4ffe-bc7f-d73e4c6f5e56 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:55.157552 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-77419852-b49d-4ffe-bc7f-d73e4c6f5e56 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:55.158026 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-77419852-b49d-4ffe-bc7f-d73e4c6f5e56 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:55.295152 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-77419852-b49d-4ffe-bc7f-d73e4c6f5e56 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:55.303642 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-77419852-b49d-4ffe-bc7f-d73e4c6f5e56 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:55.305104 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-77419852-b49d-4ffe-bc7f-d73e4c6f5e56 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:55.306362 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-77419852-b49d-4ffe-bc7f-d73e4c6f5e56 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1742 microversion: 2.20 time: 0.160647 Oct 13 04:21:55.306917 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 339/686] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:55 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:55.481683 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f360dca6-f449-498f-864c-6dde1424dd62 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:55.482299 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f360dca6-f449-498f-864c-6dde1424dd62 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:55.488236 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f360dca6-f449-498f-864c-6dde1424dd62 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:55.488684 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f360dca6-f449-498f-864c-6dde1424dd62 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:55.489452 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f360dca6-f449-498f-864c-6dde1424dd62 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:55.489908 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f360dca6-f449-498f-864c-6dde1424dd62 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:55.626024 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f360dca6-f449-498f-864c-6dde1424dd62 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:55.633853 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f360dca6-f449-498f-864c-6dde1424dd62 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.157240 Oct 13 04:21:55.634414 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 348/687] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:55 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:55.984427 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-606a5b97-5ab7-4122-a5e7-7735815abc37 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:55.986191 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-606a5b97-5ab7-4122-a5e7-7735815abc37 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:55.994360 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-606a5b97-5ab7-4122-a5e7-7735815abc37 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:55.995089 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-606a5b97-5ab7-4122-a5e7-7735815abc37 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:55.996509 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-606a5b97-5ab7-4122-a5e7-7735815abc37 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:55.997263 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-606a5b97-5ab7-4122-a5e7-7735815abc37 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:56.079896 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7473b02f-27dc-44de-b602-5d3f192fe62e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:56.080549 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7473b02f-27dc-44de-b602-5d3f192fe62e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:56.086418 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7473b02f-27dc-44de-b602-5d3f192fe62e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:56.086864 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7473b02f-27dc-44de-b602-5d3f192fe62e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:56.087673 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7473b02f-27dc-44de-b602-5d3f192fe62e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:56.088061 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7473b02f-27dc-44de-b602-5d3f192fe62e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:56.189768 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-606a5b97-5ab7-4122-a5e7-7735815abc37 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:56.197639 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-606a5b97-5ab7-4122-a5e7-7735815abc37 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.217091 Oct 13 04:21:56.198486 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 340/688] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:55 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:56.265574 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-7473b02f-27dc-44de-b602-5d3f192fe62e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:56.273810 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7473b02f-27dc-44de-b602-5d3f192fe62e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1595 microversion: 2.1 time: 0.197499 Oct 13 04:21:56.274382 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 349/689] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:56 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1595 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:56.324529 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4ff50a10-51e8-46c7-b053-b3e73ced4a04 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:56.325144 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4ff50a10-51e8-46c7-b053-b3e73ced4a04 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:56.332168 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4ff50a10-51e8-46c7-b053-b3e73ced4a04 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:56.332634 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4ff50a10-51e8-46c7-b053-b3e73ced4a04 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:56.333391 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4ff50a10-51e8-46c7-b053-b3e73ced4a04 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:56.333855 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4ff50a10-51e8-46c7-b053-b3e73ced4a04 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:56.467540 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-4ff50a10-51e8-46c7-b053-b3e73ced4a04 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:56.476575 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-4ff50a10-51e8-46c7-b053-b3e73ced4a04 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:56.478905 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-4ff50a10-51e8-46c7-b053-b3e73ced4a04 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:56.480401 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4ff50a10-51e8-46c7-b053-b3e73ced4a04 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1737 microversion: 2.20 time: 0.159634 Oct 13 04:21:56.481206 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 341/690] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:56 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:56.650798 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c8b5f37a-7fa2-4b6b-8b37-8481e3b01fd2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:56.651396 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c8b5f37a-7fa2-4b6b-8b37-8481e3b01fd2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:56.657959 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c8b5f37a-7fa2-4b6b-8b37-8481e3b01fd2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:56.658768 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c8b5f37a-7fa2-4b6b-8b37-8481e3b01fd2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:56.660120 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c8b5f37a-7fa2-4b6b-8b37-8481e3b01fd2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:56.660715 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c8b5f37a-7fa2-4b6b-8b37-8481e3b01fd2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:56.827819 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-c8b5f37a-7fa2-4b6b-8b37-8481e3b01fd2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:56.837320 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c8b5f37a-7fa2-4b6b-8b37-8481e3b01fd2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.189918 Oct 13 04:21:56.838007 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 350/691] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:56 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:57.214637 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c4987bbf-a321-4bea-91d7-278a4fce7f6a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:57.215248 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c4987bbf-a321-4bea-91d7-278a4fce7f6a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:57.231542 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c4987bbf-a321-4bea-91d7-278a4fce7f6a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:57.232063 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c4987bbf-a321-4bea-91d7-278a4fce7f6a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:57.233409 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c4987bbf-a321-4bea-91d7-278a4fce7f6a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:57.233928 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c4987bbf-a321-4bea-91d7-278a4fce7f6a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:57.380329 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c4987bbf-a321-4bea-91d7-278a4fce7f6a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:57.392306 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c4987bbf-a321-4bea-91d7-278a4fce7f6a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.181501 Oct 13 04:21:57.393504 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 342/692] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:57 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:57.499657 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-599d99ce-18d3-4138-bc3b-afc4438f8a31 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:57.500329 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-599d99ce-18d3-4138-bc3b-afc4438f8a31 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:57.513789 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-599d99ce-18d3-4138-bc3b-afc4438f8a31 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:57.514607 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-599d99ce-18d3-4138-bc3b-afc4438f8a31 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:57.516357 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-599d99ce-18d3-4138-bc3b-afc4438f8a31 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:57.518142 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-599d99ce-18d3-4138-bc3b-afc4438f8a31 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:57.688435 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-599d99ce-18d3-4138-bc3b-afc4438f8a31 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:57.697996 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-599d99ce-18d3-4138-bc3b-afc4438f8a31 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:57.699827 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-599d99ce-18d3-4138-bc3b-afc4438f8a31 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:57.701250 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-599d99ce-18d3-4138-bc3b-afc4438f8a31 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1737 microversion: 2.20 time: 0.206337 Oct 13 04:21:57.713329 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 351/693] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:57 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:21:57.858364 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a7931901-e6b8-4c4f-8b05-bf3764532629 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:57.859413 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a7931901-e6b8-4c4f-8b05-bf3764532629 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:57.867279 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a7931901-e6b8-4c4f-8b05-bf3764532629 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:57.870031 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a7931901-e6b8-4c4f-8b05-bf3764532629 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:57.871278 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a7931901-e6b8-4c4f-8b05-bf3764532629 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:57.871701 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a7931901-e6b8-4c4f-8b05-bf3764532629 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:58.128447 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a7931901-e6b8-4c4f-8b05-bf3764532629 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:58.139681 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a7931901-e6b8-4c4f-8b05-bf3764532629 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.285786 Oct 13 04:21:58.152341 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 343/694] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:57 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:21:58.411999 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4f594746-dc1a-450b-b7d5-39edb3e9b8b2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:58.413205 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4f594746-dc1a-450b-b7d5-39edb3e9b8b2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:58.420686 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4f594746-dc1a-450b-b7d5-39edb3e9b8b2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:58.421562 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4f594746-dc1a-450b-b7d5-39edb3e9b8b2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:58.422663 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4f594746-dc1a-450b-b7d5-39edb3e9b8b2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:58.423258 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4f594746-dc1a-450b-b7d5-39edb3e9b8b2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:58.588586 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4f594746-dc1a-450b-b7d5-39edb3e9b8b2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:58.608251 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4f594746-dc1a-450b-b7d5-39edb3e9b8b2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1724 microversion: 2.1 time: 0.201025 Oct 13 04:21:58.609257 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 352/695] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:58 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:21:58.716733 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-8b83b25d-93fb-4b9d-9da2-256f307d6fdf req-7a34686a-c7d4-4c23-bbde-a9dd1ec87b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e01f589-9c51-46fc-ba95-f16538ccba87", "tag": "0bd06624-1837-4923-9daf-aa14f17b4981"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:21:58.718900 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:21:58.718900 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:21:58.723071 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-34bf4362-33d0-4329-a111-649092897a3c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:58.724010 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-34bf4362-33d0-4329-a111-649092897a3c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:58.739127 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-34bf4362-33d0-4329-a111-649092897a3c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:58.739832 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-8b83b25d-93fb-4b9d-9da2-256f307d6fdf req-7a34686a-c7d4-4c23-bbde-a9dd1ec87b77 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:58.741091 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-8b83b25d-93fb-4b9d-9da2-256f307d6fdf req-7a34686a-c7d4-4c23-bbde-a9dd1ec87b77 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:58.743494 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-34bf4362-33d0-4329-a111-649092897a3c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:58.744482 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-34bf4362-33d0-4329-a111-649092897a3c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:58.745663 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-34bf4362-33d0-4329-a111-649092897a3c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:58.770819 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-8b83b25d-93fb-4b9d-9da2-256f307d6fdf req-7a34686a-c7d4-4c23-bbde-a9dd1ec87b77 service nova] Creating event network-changed:0bd06624-1837-4923-9daf-aa14f17b4981 for instance 7e01f589-9c51-46fc-ba95-f16538ccba87 on hv-cinder-81275 Oct 13 04:21:58.782333 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-8b83b25d-93fb-4b9d-9da2-256f307d6fdf req-7a34686a-c7d4-4c23-bbde-a9dd1ec87b77 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071152 Oct 13 04:21:58.782926 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 344/696] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:21:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:21:59.152562 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-34bf4362-33d0-4329-a111-649092897a3c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:59.162271 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2fe9f943-457f-4ad3-a3bf-f1e64a6c021e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:59.164819 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2fe9f943-457f-4ad3-a3bf-f1e64a6c021e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:59.173023 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-34bf4362-33d0-4329-a111-649092897a3c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:59.174605 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-34bf4362-33d0-4329-a111-649092897a3c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:59.180288 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2fe9f943-457f-4ad3-a3bf-f1e64a6c021e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:59.184599 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-34bf4362-33d0-4329-a111-649092897a3c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1737 microversion: 2.20 time: 0.468604 Oct 13 04:21:59.185292 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2fe9f943-457f-4ad3-a3bf-f1e64a6c021e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:59.186277 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2fe9f943-457f-4ad3-a3bf-f1e64a6c021e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:59.187026 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 353/697] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:21:58 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1737 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 04:21:59.199338 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2fe9f943-457f-4ad3-a3bf-f1e64a6c021e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:59.570601 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2fe9f943-457f-4ad3-a3bf-f1e64a6c021e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:21:59.609905 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2fe9f943-457f-4ad3-a3bf-f1e64a6c021e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.437049 Oct 13 04:21:59.612197 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 345/698] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:59 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:21:59.629404 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-db3afbc3-c89c-4692-8564-c4c5f85daf16 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:21:59.630916 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-db3afbc3-c89c-4692-8564-c4c5f85daf16 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:21:59.644429 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-db3afbc3-c89c-4692-8564-c4c5f85daf16 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:59.646109 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-db3afbc3-c89c-4692-8564-c4c5f85daf16 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:21:59.647408 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-db3afbc3-c89c-4692-8564-c4c5f85daf16 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:21:59.647852 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-db3afbc3-c89c-4692-8564-c4c5f85daf16 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:00.015824 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-db3afbc3-c89c-4692-8564-c4c5f85daf16 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:00.027338 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-db3afbc3-c89c-4692-8564-c4c5f85daf16 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1701 microversion: 2.1 time: 0.401641 Oct 13 04:22:00.030293 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 354/699] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:21:59 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1701 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:00.052208 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b62bdeb1-f837-41e9-bf21-07df7a12fe35 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:22:00.067606 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b62bdeb1-f837-41e9-bf21-07df7a12fe35 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:00.068232 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b62bdeb1-f837-41e9-bf21-07df7a12fe35 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:00.146932 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b62bdeb1-f837-41e9-bf21-07df7a12fe35 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Going to try to start instance {{(pid=108259) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 13 04:22:00.204722 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-16eff5b4-0f41-4006-9029-1a7c97d6537a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:00.206063 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-16eff5b4-0f41-4006-9029-1a7c97d6537a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:00.216481 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b62bdeb1-f837-41e9-bf21-07df7a12fe35 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 202 len: 0 microversion: 2.1 time: 0.172142 Oct 13 04:22:00.219010 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 346/700] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:22:00 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:22:00.224502 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-16eff5b4-0f41-4006-9029-1a7c97d6537a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:00.233438 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-268b175d-c793-4c02-8285-c8c4a7a5d7dd tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:00.234260 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-268b175d-c793-4c02-8285-c8c4a7a5d7dd tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:00.236368 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-16eff5b4-0f41-4006-9029-1a7c97d6537a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:00.237191 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-16eff5b4-0f41-4006-9029-1a7c97d6537a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:00.237643 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-16eff5b4-0f41-4006-9029-1a7c97d6537a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:00.271494 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-268b175d-c793-4c02-8285-c8c4a7a5d7dd tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:00.279058 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-268b175d-c793-4c02-8285-c8c4a7a5d7dd tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:00.279809 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-268b175d-c793-4c02-8285-c8c4a7a5d7dd tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:00.284901 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-268b175d-c793-4c02-8285-c8c4a7a5d7dd tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:00.586363 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-268b175d-c793-4c02-8285-c8c4a7a5d7dd tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:00.598212 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-16eff5b4-0f41-4006-9029-1a7c97d6537a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:00.599050 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-268b175d-c793-4c02-8285-c8c4a7a5d7dd tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1710 microversion: 2.1 time: 0.376681 Oct 13 04:22:00.599864 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 347/701] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:00 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1710 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:00.617755 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-16eff5b4-0f41-4006-9029-1a7c97d6537a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:00.620138 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-16eff5b4-0f41-4006-9029-1a7c97d6537a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:00.622090 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-16eff5b4-0f41-4006-9029-1a7c97d6537a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1737 microversion: 2.20 time: 0.421472 Oct 13 04:22:00.629899 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-66d0a708-d3c2-4890-91ad-0c619a1ae94d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:00.631665 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-66d0a708-d3c2-4890-91ad-0c619a1ae94d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:00.635086 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 355/702] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:00 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1737 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 04:22:00.640642 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-66d0a708-d3c2-4890-91ad-0c619a1ae94d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:00.641832 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-66d0a708-d3c2-4890-91ad-0c619a1ae94d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:00.642933 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-66d0a708-d3c2-4890-91ad-0c619a1ae94d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:00.643723 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-66d0a708-d3c2-4890-91ad-0c619a1ae94d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:00.703847 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-cff6cd52-81ef-4ffa-a405-f147cc6f8690 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-792952520"}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:22:00.705413 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-cff6cd52-81ef-4ffa-a405-f147cc6f8690 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:00.717931 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cff6cd52-81ef-4ffa-a405-f147cc6f8690 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:00.719088 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cff6cd52-81ef-4ffa-a405-f147cc6f8690 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:00.720069 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cff6cd52-81ef-4ffa-a405-f147cc6f8690 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:00.721230 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cff6cd52-81ef-4ffa-a405-f147cc6f8690 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:01.038564 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-66d0a708-d3c2-4890-91ad-0c619a1ae94d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:01.048653 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-66d0a708-d3c2-4890-91ad-0c619a1ae94d tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.423854 Oct 13 04:22:01.051229 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 348/703] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:00 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:01.074444 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.network.security_group_api [None req-cff6cd52-81ef-4ffa-a405-f147cc6f8690 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Adding security group 20e7d3f0-2df7-482e-a611-7c5c3227420e to port 0bd06624-1837-4923-9daf-aa14f17b4981 Oct 13 04:22:01.624702 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f3c1a0ae-2ab8-4357-98de-b59db66193f0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:01.628099 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f3c1a0ae-2ab8-4357-98de-b59db66193f0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:01.638598 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3c1a0ae-2ab8-4357-98de-b59db66193f0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:01.642119 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3c1a0ae-2ab8-4357-98de-b59db66193f0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:01.643963 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3c1a0ae-2ab8-4357-98de-b59db66193f0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:01.644621 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3c1a0ae-2ab8-4357-98de-b59db66193f0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:01.868921 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-cff6cd52-81ef-4ffa-a405-f147cc6f8690 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "POST /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/action" status: 202 len: 0 microversion: 2.1 time: 1.169179 Oct 13 04:22:01.870771 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 356/704] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:22:00 2021] POST /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/action => generated 0 bytes in 1172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:22:01.880284 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-8949b2a6-16fc-4fbf-94bf-68523eab49f1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:01.881204 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-8949b2a6-16fc-4fbf-94bf-68523eab49f1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:01.892159 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8949b2a6-16fc-4fbf-94bf-68523eab49f1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:01.892991 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8949b2a6-16fc-4fbf-94bf-68523eab49f1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:01.894388 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8949b2a6-16fc-4fbf-94bf-68523eab49f1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:01.895037 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8949b2a6-16fc-4fbf-94bf-68523eab49f1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:01.916080 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f3c1a0ae-2ab8-4357-98de-b59db66193f0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:01.941195 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f3c1a0ae-2ab8-4357-98de-b59db66193f0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1710 microversion: 2.1 time: 0.327262 Oct 13 04:22:01.942969 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 349/705] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:01 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1710 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:01.959007 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a5e003d0-172e-4023-a785-107cfeb1cffb tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:01.959789 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a5e003d0-172e-4023-a785-107cfeb1cffb tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:01.974096 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a5e003d0-172e-4023-a785-107cfeb1cffb tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:01.974626 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a5e003d0-172e-4023-a785-107cfeb1cffb tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:01.975480 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a5e003d0-172e-4023-a785-107cfeb1cffb tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:01.976120 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a5e003d0-172e-4023-a785-107cfeb1cffb tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:02.156243 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-8949b2a6-16fc-4fbf-94bf-68523eab49f1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:02.169967 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-8949b2a6-16fc-4fbf-94bf-68523eab49f1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:02.171811 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-8949b2a6-16fc-4fbf-94bf-68523eab49f1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:02.173441 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-8949b2a6-16fc-4fbf-94bf-68523eab49f1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1737 microversion: 2.20 time: 0.299674 Oct 13 04:22:02.189193 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 357/706] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:01 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1737 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:02.205207 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-658e590c-c045-414d-aa40-bcf23fee0096 req-98189751-4d5a-46cb-af7f-131d609ff0ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e01f589-9c51-46fc-ba95-f16538ccba87", "tag": "0bd06624-1837-4923-9daf-aa14f17b4981"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:22:02.213584 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:22:02.213584 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:22:02.222401 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a5e003d0-172e-4023-a785-107cfeb1cffb tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:02.228487 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-658e590c-c045-414d-aa40-bcf23fee0096 req-98189751-4d5a-46cb-af7f-131d609ff0ba service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:02.228487 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-658e590c-c045-414d-aa40-bcf23fee0096 req-98189751-4d5a-46cb-af7f-131d609ff0ba service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:02.233717 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a5e003d0-172e-4023-a785-107cfeb1cffb tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1760 microversion: 2.1 time: 0.289285 Oct 13 04:22:02.234643 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 350/707] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:01 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1760 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:02.239906 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ca4ac76e-34b9-4c7d-980d-c1425fc1355e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:02.240712 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ca4ac76e-34b9-4c7d-980d-c1425fc1355e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:02.247147 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ca4ac76e-34b9-4c7d-980d-c1425fc1355e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:02.247846 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ca4ac76e-34b9-4c7d-980d-c1425fc1355e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:02.248780 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ca4ac76e-34b9-4c7d-980d-c1425fc1355e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:02.249368 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ca4ac76e-34b9-4c7d-980d-c1425fc1355e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:02.252552 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-658e590c-c045-414d-aa40-bcf23fee0096 req-98189751-4d5a-46cb-af7f-131d609ff0ba service nova] Creating event network-changed:0bd06624-1837-4923-9daf-aa14f17b4981 for instance 7e01f589-9c51-46fc-ba95-f16538ccba87 on hv-cinder-81275 Oct 13 04:22:02.262657 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-658e590c-c045-414d-aa40-bcf23fee0096 req-98189751-4d5a-46cb-af7f-131d609ff0ba service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071835 Oct 13 04:22:02.265811 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 358/708] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:22:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:22:02.549409 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ca4ac76e-34b9-4c7d-980d-c1425fc1355e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:02.561343 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ca4ac76e-34b9-4c7d-980d-c1425fc1355e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.321663 Oct 13 04:22:02.562522 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 351/709] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:02 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:02.960214 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d08a7caf-7623-4b3f-972e-6614c335ffc4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:02.961190 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d08a7caf-7623-4b3f-972e-6614c335ffc4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:02.972235 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d08a7caf-7623-4b3f-972e-6614c335ffc4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:02.972997 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d08a7caf-7623-4b3f-972e-6614c335ffc4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:02.975706 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d08a7caf-7623-4b3f-972e-6614c335ffc4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:02.977251 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d08a7caf-7623-4b3f-972e-6614c335ffc4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:03.197096 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-20bcfa74-19a5-4eeb-a48a-d9bc166861f2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:03.199830 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-20bcfa74-19a5-4eeb-a48a-d9bc166861f2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:03.211182 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-20bcfa74-19a5-4eeb-a48a-d9bc166861f2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:03.213013 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-20bcfa74-19a5-4eeb-a48a-d9bc166861f2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:03.215278 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-20bcfa74-19a5-4eeb-a48a-d9bc166861f2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:03.216051 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-20bcfa74-19a5-4eeb-a48a-d9bc166861f2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:03.276895 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d08a7caf-7623-4b3f-972e-6614c335ffc4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:03.285472 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d08a7caf-7623-4b3f-972e-6614c335ffc4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1714 microversion: 2.1 time: 0.329511 Oct 13 04:22:03.302930 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 359/710] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:02 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1714 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:03.429427 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-20bcfa74-19a5-4eeb-a48a-d9bc166861f2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:03.437735 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-20bcfa74-19a5-4eeb-a48a-d9bc166861f2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:03.439547 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-20bcfa74-19a5-4eeb-a48a-d9bc166861f2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:03.441046 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-20bcfa74-19a5-4eeb-a48a-d9bc166861f2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1737 microversion: 2.20 time: 0.249907 Oct 13 04:22:03.442018 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 352/711] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:03 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1737 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:03.580323 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-20a19e67-0d48-41ed-b2ed-184dd37d78e3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:03.581588 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-20a19e67-0d48-41ed-b2ed-184dd37d78e3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:03.588666 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-20a19e67-0d48-41ed-b2ed-184dd37d78e3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:03.589414 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-20a19e67-0d48-41ed-b2ed-184dd37d78e3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:03.590866 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-20a19e67-0d48-41ed-b2ed-184dd37d78e3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:03.591411 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-20a19e67-0d48-41ed-b2ed-184dd37d78e3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:03.802055 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-20a19e67-0d48-41ed-b2ed-184dd37d78e3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:03.819281 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-20a19e67-0d48-41ed-b2ed-184dd37d78e3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.243475 Oct 13 04:22:03.820143 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 360/712] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:03 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:22:04.460781 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-60ce73ba-706e-4d81-86b1-cda20e53261d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:04.461405 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-60ce73ba-706e-4d81-86b1-cda20e53261d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:04.468495 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-60ce73ba-706e-4d81-86b1-cda20e53261d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:04.469315 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-60ce73ba-706e-4d81-86b1-cda20e53261d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:04.470834 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-60ce73ba-706e-4d81-86b1-cda20e53261d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:04.471272 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-60ce73ba-706e-4d81-86b1-cda20e53261d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:04.696767 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-60ce73ba-706e-4d81-86b1-cda20e53261d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:04.705848 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-60ce73ba-706e-4d81-86b1-cda20e53261d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:04.707790 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-60ce73ba-706e-4d81-86b1-cda20e53261d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:04.709067 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-60ce73ba-706e-4d81-86b1-cda20e53261d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1737 microversion: 2.20 time: 0.253199 Oct 13 04:22:04.720383 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 353/713] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:04 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1737 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 04:22:04.838004 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d6b3df51-d809-49ae-8ec2-ec5846605225 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:04.840496 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d6b3df51-d809-49ae-8ec2-ec5846605225 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:04.850612 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d6b3df51-d809-49ae-8ec2-ec5846605225 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:04.851328 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d6b3df51-d809-49ae-8ec2-ec5846605225 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:04.852257 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d6b3df51-d809-49ae-8ec2-ec5846605225 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:04.852782 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d6b3df51-d809-49ae-8ec2-ec5846605225 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:04.988647 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d6b3df51-d809-49ae-8ec2-ec5846605225 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:04.996556 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d6b3df51-d809-49ae-8ec2-ec5846605225 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.163680 Oct 13 04:22:05.008198 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 361/714] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:04 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:05.727212 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4da8a300-9da3-4044-aac4-c3eaefd2122f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:05.727812 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4da8a300-9da3-4044-aac4-c3eaefd2122f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:05.734011 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4da8a300-9da3-4044-aac4-c3eaefd2122f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:05.734709 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4da8a300-9da3-4044-aac4-c3eaefd2122f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:05.735664 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4da8a300-9da3-4044-aac4-c3eaefd2122f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:05.736376 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4da8a300-9da3-4044-aac4-c3eaefd2122f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:05.871786 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-4da8a300-9da3-4044-aac4-c3eaefd2122f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:05.880500 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-4da8a300-9da3-4044-aac4-c3eaefd2122f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:05.882373 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-4da8a300-9da3-4044-aac4-c3eaefd2122f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:05.883603 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4da8a300-9da3-4044-aac4-c3eaefd2122f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1737 microversion: 2.20 time: 0.160014 Oct 13 04:22:05.884582 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 354/715] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:05 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:06.015794 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5d24498d-c4ea-4a3c-873b-49a2995d475a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:06.016408 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5d24498d-c4ea-4a3c-873b-49a2995d475a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:06.024049 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5d24498d-c4ea-4a3c-873b-49a2995d475a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:06.024902 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5d24498d-c4ea-4a3c-873b-49a2995d475a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:06.026642 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5d24498d-c4ea-4a3c-873b-49a2995d475a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:06.027295 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5d24498d-c4ea-4a3c-873b-49a2995d475a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:06.181373 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5d24498d-c4ea-4a3c-873b-49a2995d475a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:06.189704 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5d24498d-c4ea-4a3c-873b-49a2995d475a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.178641 Oct 13 04:22:06.190278 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 362/716] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:06 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:06.902132 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0bfccc01-cfb6-47fd-97da-d232eda5fbd1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:06.903434 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0bfccc01-cfb6-47fd-97da-d232eda5fbd1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:06.909959 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0bfccc01-cfb6-47fd-97da-d232eda5fbd1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:06.910680 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0bfccc01-cfb6-47fd-97da-d232eda5fbd1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:06.911442 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0bfccc01-cfb6-47fd-97da-d232eda5fbd1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:06.911850 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0bfccc01-cfb6-47fd-97da-d232eda5fbd1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:07.042394 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-0bfccc01-cfb6-47fd-97da-d232eda5fbd1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:07.050661 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-0bfccc01-cfb6-47fd-97da-d232eda5fbd1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:07.052301 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-0bfccc01-cfb6-47fd-97da-d232eda5fbd1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:07.053527 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0bfccc01-cfb6-47fd-97da-d232eda5fbd1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1737 microversion: 2.20 time: 0.155561 Oct 13 04:22:07.064646 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 355/717] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:06 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:07.207590 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-95041d19-53aa-40f9-8694-c5a977f08d8f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:07.209317 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-95041d19-53aa-40f9-8694-c5a977f08d8f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:07.215930 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-95041d19-53aa-40f9-8694-c5a977f08d8f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:07.216623 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-95041d19-53aa-40f9-8694-c5a977f08d8f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:07.218156 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-95041d19-53aa-40f9-8694-c5a977f08d8f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:07.223097 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-95041d19-53aa-40f9-8694-c5a977f08d8f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:07.373136 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-95041d19-53aa-40f9-8694-c5a977f08d8f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:07.381403 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-95041d19-53aa-40f9-8694-c5a977f08d8f tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.177902 Oct 13 04:22:07.382030 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 363/718] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:07 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:08.075900 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-dfe27ab5-ce6c-4bfb-9257-41f58f59065b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:08.076818 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-dfe27ab5-ce6c-4bfb-9257-41f58f59065b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:08.087115 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dfe27ab5-ce6c-4bfb-9257-41f58f59065b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:08.087858 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dfe27ab5-ce6c-4bfb-9257-41f58f59065b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:08.089118 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dfe27ab5-ce6c-4bfb-9257-41f58f59065b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:08.089882 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dfe27ab5-ce6c-4bfb-9257-41f58f59065b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:08.216365 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-dfe27ab5-ce6c-4bfb-9257-41f58f59065b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:08.224391 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-dfe27ab5-ce6c-4bfb-9257-41f58f59065b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:08.225896 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-dfe27ab5-ce6c-4bfb-9257-41f58f59065b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:08.227029 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-dfe27ab5-ce6c-4bfb-9257-41f58f59065b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1737 microversion: 2.20 time: 0.157527 Oct 13 04:22:08.227593 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 356/719] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:08 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:08.403332 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6b6cd9a3-c5c2-4bce-b68a-a802c212537b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:08.403903 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6b6cd9a3-c5c2-4bce-b68a-a802c212537b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:08.410718 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6b6cd9a3-c5c2-4bce-b68a-a802c212537b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:08.411179 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6b6cd9a3-c5c2-4bce-b68a-a802c212537b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:08.411938 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6b6cd9a3-c5c2-4bce-b68a-a802c212537b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:08.412377 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6b6cd9a3-c5c2-4bce-b68a-a802c212537b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:08.543718 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6b6cd9a3-c5c2-4bce-b68a-a802c212537b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:08.552056 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6b6cd9a3-c5c2-4bce-b68a-a802c212537b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.152342 Oct 13 04:22:08.552833 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 364/720] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:08 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:09.244438 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b7abb421-a3b3-40ca-a9af-7cc6872c3f89 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:09.245079 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b7abb421-a3b3-40ca-a9af-7cc6872c3f89 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:09.251196 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b7abb421-a3b3-40ca-a9af-7cc6872c3f89 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:09.251637 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b7abb421-a3b3-40ca-a9af-7cc6872c3f89 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:09.252370 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b7abb421-a3b3-40ca-a9af-7cc6872c3f89 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:09.252822 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b7abb421-a3b3-40ca-a9af-7cc6872c3f89 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:09.388453 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b7abb421-a3b3-40ca-a9af-7cc6872c3f89 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:09.396711 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b7abb421-a3b3-40ca-a9af-7cc6872c3f89 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:09.398205 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b7abb421-a3b3-40ca-a9af-7cc6872c3f89 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:09.399335 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b7abb421-a3b3-40ca-a9af-7cc6872c3f89 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1719 microversion: 2.20 time: 0.158688 Oct 13 04:22:09.399887 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 357/721] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:09 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:09.569399 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c95ed115-be70-4baa-8d6f-88e6b5154089 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:09.570253 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c95ed115-be70-4baa-8d6f-88e6b5154089 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:09.576193 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c95ed115-be70-4baa-8d6f-88e6b5154089 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:09.576673 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c95ed115-be70-4baa-8d6f-88e6b5154089 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:09.577424 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c95ed115-be70-4baa-8d6f-88e6b5154089 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:09.577881 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c95ed115-be70-4baa-8d6f-88e6b5154089 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:09.697791 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-c95ed115-be70-4baa-8d6f-88e6b5154089 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:09.705542 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c95ed115-be70-4baa-8d6f-88e6b5154089 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.140127 Oct 13 04:22:09.706168 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 365/722] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:09 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:10.422669 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-92686a63-ece6-4572-a0ec-d8e1f2f0711c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:10.423854 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-92686a63-ece6-4572-a0ec-d8e1f2f0711c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:10.434498 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-92686a63-ece6-4572-a0ec-d8e1f2f0711c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:10.435215 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-92686a63-ece6-4572-a0ec-d8e1f2f0711c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:10.436450 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-92686a63-ece6-4572-a0ec-d8e1f2f0711c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:10.437148 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-92686a63-ece6-4572-a0ec-d8e1f2f0711c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:10.562639 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-92686a63-ece6-4572-a0ec-d8e1f2f0711c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:10.571263 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-92686a63-ece6-4572-a0ec-d8e1f2f0711c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:10.572749 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-92686a63-ece6-4572-a0ec-d8e1f2f0711c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:10.573939 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-92686a63-ece6-4572-a0ec-d8e1f2f0711c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1719 microversion: 2.20 time: 0.158130 Oct 13 04:22:10.574525 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 358/723] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:10 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:10.726633 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ca590a1f-d7e0-4cd4-81a3-7935ad276c83 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:10.727621 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ca590a1f-d7e0-4cd4-81a3-7935ad276c83 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:10.736774 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ca590a1f-d7e0-4cd4-81a3-7935ad276c83 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:10.737225 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ca590a1f-d7e0-4cd4-81a3-7935ad276c83 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:10.738010 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ca590a1f-d7e0-4cd4-81a3-7935ad276c83 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:10.738438 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ca590a1f-d7e0-4cd4-81a3-7935ad276c83 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:10.870472 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-ca590a1f-d7e0-4cd4-81a3-7935ad276c83 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:10.878331 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ca590a1f-d7e0-4cd4-81a3-7935ad276c83 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.157897 Oct 13 04:22:10.878905 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 366/724] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:10 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:11.100063 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-34ed65b5-451b-4b47-8e47-6ba9a0a1cedc tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1304621883", "imageRef": "4f468f34-171a-4b6e-a0cd-2e4c6fcda23d", "flavorRef": "452"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:22:11.152637 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.network.neutron [None req-34ed65b5-451b-4b47-8e47-6ba9a0a1cedc tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] validate_networks() for None {{(pid=108259) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:22:11.421264 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-34ed65b5-451b-4b47-8e47-6ba9a0a1cedc tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Flavor limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:22:11.421697 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-34ed65b5-451b-4b47-8e47-6ba9a0a1cedc tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Image limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:22:11.422169 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-34ed65b5-451b-4b47-8e47-6ba9a0a1cedc tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Flavor pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:22:11.422570 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-34ed65b5-451b-4b47-8e47-6ba9a0a1cedc tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Image pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:22:11.422977 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-34ed65b5-451b-4b47-8e47-6ba9a0a1cedc tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:22:11.432243 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-34ed65b5-451b-4b47-8e47-6ba9a0a1cedc tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:11.432690 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-34ed65b5-451b-4b47-8e47-6ba9a0a1cedc tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:11.433485 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-34ed65b5-451b-4b47-8e47-6ba9a0a1cedc tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:11.433945 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-34ed65b5-451b-4b47-8e47-6ba9a0a1cedc tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:11.452036 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-34ed65b5-451b-4b47-8e47-6ba9a0a1cedc tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Getting quotas for project b01a13a65c994bd083bbc582b1e9acf9. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:22:11.457008 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-34ed65b5-451b-4b47-8e47-6ba9a0a1cedc tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Getting quotas for user e254c10abf0d4818abe81e9a550720b6 and project b01a13a65c994bd083bbc582b1e9acf9. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:22:11.468167 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-34ed65b5-451b-4b47-8e47-6ba9a0a1cedc tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Going to run 1 instances... {{(pid=108259) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:22:11.470754 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-34ed65b5-451b-4b47-8e47-6ba9a0a1cedc tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f468f34-171a-4b6e-a0cd-2e4c6fcda23d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:22:11.515929 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-34ed65b5-451b-4b47-8e47-6ba9a0a1cedc tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.419588 Oct 13 04:22:11.516950 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 359/725] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Oct 13 04:22:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 04:22:11.527613 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-cb14fd41-9b7b-4fa3-a95c-3150ec468445 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:11.528295 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-cb14fd41-9b7b-4fa3-a95c-3150ec468445 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:11.581672 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-cb14fd41-9b7b-4fa3-a95c-3150ec468445 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:11.589139 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-cb14fd41-9b7b-4fa3-a95c-3150ec468445 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1215 microversion: 2.1 time: 0.065649 Oct 13 04:22:11.589725 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 367/726] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:11 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:11.598628 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a8264e27-42a8-481b-9ca8-83b056955df1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:11.598628 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a8264e27-42a8-481b-9ca8-83b056955df1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:11.599739 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a8264e27-42a8-481b-9ca8-83b056955df1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:11.600232 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a8264e27-42a8-481b-9ca8-83b056955df1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:11.601040 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a8264e27-42a8-481b-9ca8-83b056955df1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:11.601523 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a8264e27-42a8-481b-9ca8-83b056955df1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:11.729522 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a8264e27-42a8-481b-9ca8-83b056955df1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:11.737970 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a8264e27-42a8-481b-9ca8-83b056955df1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:11.739463 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a8264e27-42a8-481b-9ca8-83b056955df1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:11.740652 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a8264e27-42a8-481b-9ca8-83b056955df1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1662 microversion: 2.20 time: 0.152224 Oct 13 04:22:11.741250 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 360/727] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:11 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1662 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:11.759155 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-70ba816f-623b-4313-864c-c14977311b06 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "823173b8-af8b-4201-9f1f-2695a83ceb29"}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:22:11.760220 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-70ba816f-623b-4313-864c-c14977311b06 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:11.766202 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-70ba816f-623b-4313-864c-c14977311b06 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:11.766629 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-70ba816f-623b-4313-864c-c14977311b06 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:11.767677 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-70ba816f-623b-4313-864c-c14977311b06 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:11.768086 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-70ba816f-623b-4313-864c-c14977311b06 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:11.896453 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e98303fd-1557-4b96-9268-96913590b97b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:11.897231 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e98303fd-1557-4b96-9268-96913590b97b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:11.904303 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e98303fd-1557-4b96-9268-96913590b97b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:11.904803 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e98303fd-1557-4b96-9268-96913590b97b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:11.905689 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e98303fd-1557-4b96-9268-96913590b97b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:11.906145 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e98303fd-1557-4b96-9268-96913590b97b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:12.033013 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-e98303fd-1557-4b96-9268-96913590b97b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:12.046497 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e98303fd-1557-4b96-9268-96913590b97b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.153905 Oct 13 04:22:12.047120 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 361/728] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:11 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:12.062110 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-70ba816f-623b-4313-864c-c14977311b06 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306679 Oct 13 04:22:12.062712 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 368/729] 10.222.0.55 () {62 vars in 1363 bytes} [Wed Oct 13 04:22:11 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:22:12.168988 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-30552601-afa0-4151-9edf-5c0ad8f7d176 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:22:12.169556 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-30552601-afa0-4151-9edf-5c0ad8f7d176 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:12.176154 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30552601-afa0-4151-9edf-5c0ad8f7d176 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:12.176589 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30552601-afa0-4151-9edf-5c0ad8f7d176 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:12.177337 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30552601-afa0-4151-9edf-5c0ad8f7d176 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:12.177790 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30552601-afa0-4151-9edf-5c0ad8f7d176 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:12.268982 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-30552601-afa0-4151-9edf-5c0ad8f7d176 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action" status: 202 len: 0 microversion: 2.20 time: 0.103759 Oct 13 04:22:12.272758 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 362/730] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:22:12 2021] POST /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:22:12.278334 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d91c73c0-622a-4526-9dea-a85bf4213dfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:12.278334 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d91c73c0-622a-4526-9dea-a85bf4213dfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:12.285506 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d91c73c0-622a-4526-9dea-a85bf4213dfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:12.285972 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d91c73c0-622a-4526-9dea-a85bf4213dfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:12.286723 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d91c73c0-622a-4526-9dea-a85bf4213dfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:12.287144 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d91c73c0-622a-4526-9dea-a85bf4213dfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:12.411353 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d91c73c0-622a-4526-9dea-a85bf4213dfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:12.419837 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d91c73c0-622a-4526-9dea-a85bf4213dfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:12.421404 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d91c73c0-622a-4526-9dea-a85bf4213dfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:12.422607 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d91c73c0-622a-4526-9dea-a85bf4213dfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1748 microversion: 2.20 time: 0.148532 Oct 13 04:22:12.423547 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 369/731] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:12 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1748 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:12.606106 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-6bf25774-4266-4d79-bd28-f27c5e573092 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:12.606797 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-6bf25774-4266-4d79-bd28-f27c5e573092 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:12.613126 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6bf25774-4266-4d79-bd28-f27c5e573092 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:12.613653 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6bf25774-4266-4d79-bd28-f27c5e573092 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:12.614539 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6bf25774-4266-4d79-bd28-f27c5e573092 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:12.615099 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6bf25774-4266-4d79-bd28-f27c5e573092 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:12.690247 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-6bf25774-4266-4d79-bd28-f27c5e573092 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:12.697844 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-6bf25774-4266-4d79-bd28-f27c5e573092 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1273 microversion: 2.1 time: 0.095465 Oct 13 04:22:12.698391 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 363/732] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:12 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:22:13.064126 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4d1a3920-4068-41a9-b181-e5d81beb3bd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:13.065179 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4d1a3920-4068-41a9-b181-e5d81beb3bd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:13.070835 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4d1a3920-4068-41a9-b181-e5d81beb3bd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:13.071259 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4d1a3920-4068-41a9-b181-e5d81beb3bd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:13.072024 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4d1a3920-4068-41a9-b181-e5d81beb3bd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:13.072443 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4d1a3920-4068-41a9-b181-e5d81beb3bd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:13.350090 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4d1a3920-4068-41a9-b181-e5d81beb3bd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:13.357983 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4d1a3920-4068-41a9-b181-e5d81beb3bd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.298272 Oct 13 04:22:13.368303 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 370/733] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:13 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:13.441883 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ba9346cd-dbd1-46e2-9db1-7f0f5b984e43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:13.442476 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ba9346cd-dbd1-46e2-9db1-7f0f5b984e43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:13.448236 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ba9346cd-dbd1-46e2-9db1-7f0f5b984e43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:13.448672 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ba9346cd-dbd1-46e2-9db1-7f0f5b984e43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:13.449450 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ba9346cd-dbd1-46e2-9db1-7f0f5b984e43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:13.449891 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ba9346cd-dbd1-46e2-9db1-7f0f5b984e43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:13.556553 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-428cf754-54f5-4104-8b49-e541d21b60bd req-04c3a962-929a-4bf2-a585-0004478b9f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c2b8a8f-db02-4581-b497-1f4caa68240f", "name": "network-vif-unplugged", "status": "completed", "tag": "819b5060-2257-431d-a719-93e3e23c273c"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:22:13.558365 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:22:13.558365 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:22:13.566657 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-428cf754-54f5-4104-8b49-e541d21b60bd req-04c3a962-929a-4bf2-a585-0004478b9f94 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:13.567255 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-428cf754-54f5-4104-8b49-e541d21b60bd req-04c3a962-929a-4bf2-a585-0004478b9f94 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:13.580245 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.compute.server_external_events [req-428cf754-54f5-4104-8b49-e541d21b60bd req-04c3a962-929a-4bf2-a585-0004478b9f94 service nova] Unable to find a host for instance 3c2b8a8f-db02-4581-b497-1f4caa68240f. Dropping event network-vif-unplugged {{(pid=108260) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 13 04:22:13.581200 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-428cf754-54f5-4104-8b49-e541d21b60bd req-04c3a962-929a-4bf2-a585-0004478b9f94 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028765 Oct 13 04:22:13.582318 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 371/734] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:22:13 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 13 04:22:13.644254 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ba9346cd-dbd1-46e2-9db1-7f0f5b984e43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:13.653716 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ba9346cd-dbd1-46e2-9db1-7f0f5b984e43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:13.655440 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ba9346cd-dbd1-46e2-9db1-7f0f5b984e43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:13.656353 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ba9346cd-dbd1-46e2-9db1-7f0f5b984e43 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1750 microversion: 2.20 time: 0.218253 Oct 13 04:22:13.657217 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 364/735] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:13 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1750 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:13.714795 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1364ee64-5785-451b-96d7-6c3018faff29 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:13.715406 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-1364ee64-5785-451b-96d7-6c3018faff29 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:13.721595 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1364ee64-5785-451b-96d7-6c3018faff29 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:13.722261 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1364ee64-5785-451b-96d7-6c3018faff29 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:13.723038 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1364ee64-5785-451b-96d7-6c3018faff29 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:13.723467 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1364ee64-5785-451b-96d7-6c3018faff29 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:13.920359 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-1364ee64-5785-451b-96d7-6c3018faff29 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:13.930900 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-1364ee64-5785-451b-96d7-6c3018faff29 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.219696 Oct 13 04:22:13.931486 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 372/736] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:13 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:14.376220 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1d647e0b-5151-4705-8b37-846264ba92cd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:14.377237 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1d647e0b-5151-4705-8b37-846264ba92cd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:14.383791 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1d647e0b-5151-4705-8b37-846264ba92cd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:14.384278 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1d647e0b-5151-4705-8b37-846264ba92cd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:14.385038 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1d647e0b-5151-4705-8b37-846264ba92cd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:14.385546 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1d647e0b-5151-4705-8b37-846264ba92cd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:14.486298 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-ec2476ce-af40-45bf-b74f-51011ceb033c req-b40c16cf-0a6d-48c1-ab50-00ac0d5c602c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e39ca441-9306-4e97-8dee-e2ae3367c0dc", "tag": "6a971d86-b9a8-4230-9244-991803f191ba"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:22:14.488571 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:22:14.488571 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:22:14.500108 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-ec2476ce-af40-45bf-b74f-51011ceb033c req-b40c16cf-0a6d-48c1-ab50-00ac0d5c602c service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:14.500626 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-ec2476ce-af40-45bf-b74f-51011ceb033c req-b40c16cf-0a6d-48c1-ab50-00ac0d5c602c service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:14.524090 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-ec2476ce-af40-45bf-b74f-51011ceb033c req-b40c16cf-0a6d-48c1-ab50-00ac0d5c602c service nova] Creating event network-changed:6a971d86-b9a8-4230-9244-991803f191ba for instance e39ca441-9306-4e97-8dee-e2ae3367c0dc on hv-cinder-81275 Oct 13 04:22:14.529755 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-ec2476ce-af40-45bf-b74f-51011ceb033c req-b40c16cf-0a6d-48c1-ab50-00ac0d5c602c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046944 Oct 13 04:22:14.530844 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 373/737] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:22:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:22:14.676355 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f6ca5f66-1bb1-41c8-90f4-84661b61207e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:14.677125 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f6ca5f66-1bb1-41c8-90f4-84661b61207e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:14.683605 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f6ca5f66-1bb1-41c8-90f4-84661b61207e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:14.684113 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f6ca5f66-1bb1-41c8-90f4-84661b61207e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:14.685141 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f6ca5f66-1bb1-41c8-90f4-84661b61207e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:14.685564 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f6ca5f66-1bb1-41c8-90f4-84661b61207e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:14.730468 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1d647e0b-5151-4705-8b37-846264ba92cd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:14.738895 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1d647e0b-5151-4705-8b37-846264ba92cd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1566 microversion: 2.1 time: 0.366786 Oct 13 04:22:14.739498 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 365/738] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:14 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1566 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:22:14.949343 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1aae18b4-5b19-427b-bcfa-9b079fb5237a tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:14.949972 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1aae18b4-5b19-427b-bcfa-9b079fb5237a tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:14.957173 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1aae18b4-5b19-427b-bcfa-9b079fb5237a tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:14.957452 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f6ca5f66-1bb1-41c8-90f4-84661b61207e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:14.957693 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1aae18b4-5b19-427b-bcfa-9b079fb5237a tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:14.958836 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1aae18b4-5b19-427b-bcfa-9b079fb5237a tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:14.959480 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1aae18b4-5b19-427b-bcfa-9b079fb5237a tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:14.969089 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f6ca5f66-1bb1-41c8-90f4-84661b61207e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:14.970873 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f6ca5f66-1bb1-41c8-90f4-84661b61207e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:14.972409 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f6ca5f66-1bb1-41c8-90f4-84661b61207e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.299953 Oct 13 04:22:14.973113 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 374/739] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:14 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:15.267782 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1aae18b4-5b19-427b-bcfa-9b079fb5237a tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:15.275473 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1aae18b4-5b19-427b-bcfa-9b079fb5237a tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.330467 Oct 13 04:22:15.276127 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 366/740] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:14 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:15.756265 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c969f642-45d9-403a-8218-57a655cf648e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:15.756821 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c969f642-45d9-403a-8218-57a655cf648e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:15.763195 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c969f642-45d9-403a-8218-57a655cf648e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:15.763653 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c969f642-45d9-403a-8218-57a655cf648e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:15.764400 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c969f642-45d9-403a-8218-57a655cf648e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:15.764830 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c969f642-45d9-403a-8218-57a655cf648e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:15.990628 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2c87d9f1-b83c-4c8c-9a71-9219ca4586d5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:15.991483 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2c87d9f1-b83c-4c8c-9a71-9219ca4586d5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:15.998073 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2c87d9f1-b83c-4c8c-9a71-9219ca4586d5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:15.998601 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2c87d9f1-b83c-4c8c-9a71-9219ca4586d5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:15.999283 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2c87d9f1-b83c-4c8c-9a71-9219ca4586d5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:15.999708 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2c87d9f1-b83c-4c8c-9a71-9219ca4586d5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:16.209166 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-c969f642-45d9-403a-8218-57a655cf648e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:16.224678 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c969f642-45d9-403a-8218-57a655cf648e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1546 microversion: 2.1 time: 0.465153 Oct 13 04:22:16.225996 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 375/741] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:15 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1546 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:16.233724 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2c87d9f1-b83c-4c8c-9a71-9219ca4586d5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:16.241628 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-03f81ebd-cf31-47e5-bace-0a83c765bd1b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:16.242364 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-03f81ebd-cf31-47e5-bace-0a83c765bd1b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:16.251474 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-03f81ebd-cf31-47e5-bace-0a83c765bd1b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:16.251926 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-03f81ebd-cf31-47e5-bace-0a83c765bd1b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:16.252694 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-03f81ebd-cf31-47e5-bace-0a83c765bd1b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:16.256019 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2c87d9f1-b83c-4c8c-9a71-9219ca4586d5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:16.258191 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-03f81ebd-cf31-47e5-bace-0a83c765bd1b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:16.258727 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2c87d9f1-b83c-4c8c-9a71-9219ca4586d5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:16.259996 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2c87d9f1-b83c-4c8c-9a71-9219ca4586d5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.273110 Oct 13 04:22:16.263202 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 367/742] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:15 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:16.292166 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2bc00aea-30db-4f63-9ccb-13daa7588f51 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:16.293127 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2bc00aea-30db-4f63-9ccb-13daa7588f51 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:16.308488 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2bc00aea-30db-4f63-9ccb-13daa7588f51 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:16.309327 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2bc00aea-30db-4f63-9ccb-13daa7588f51 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:16.311307 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2bc00aea-30db-4f63-9ccb-13daa7588f51 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:16.311920 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2bc00aea-30db-4f63-9ccb-13daa7588f51 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:16.380251 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-03f81ebd-cf31-47e5-bace-0a83c765bd1b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] HTTP exception thrown: Cannot 'detach_volume' instance 2b4223c8-bfe1-440e-89bc-7158a1490e1c while it is in vm_state rescued Oct 13 04:22:16.381267 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-03f81ebd-cf31-47e5-bace-0a83c765bd1b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Returning 409 to user: Cannot 'detach_volume' instance 2b4223c8-bfe1-440e-89bc-7158a1490e1c while it is in vm_state rescued {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:22:16.382315 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-03f81ebd-cf31-47e5-bace-0a83c765bd1b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "DELETE /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/os-volume_attachments/a05b86bd-7ba5-4743-8ad1-bf77418a7c57" status: 409 len: 152 microversion: 2.1 time: 0.144635 Oct 13 04:22:16.386549 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 376/743] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Oct 13 04:22:16 2021] DELETE /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/os-volume_attachments/a05b86bd-7ba5-4743-8ad1-bf77418a7c57 => generated 152 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 13 04:22:16.391643 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a8b4f7f5-85e0-4a40-a51d-93745d09bedd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:22:16.392400 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a8b4f7f5-85e0-4a40-a51d-93745d09bedd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:16.399029 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a8b4f7f5-85e0-4a40-a51d-93745d09bedd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:16.399471 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a8b4f7f5-85e0-4a40-a51d-93745d09bedd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:16.400431 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a8b4f7f5-85e0-4a40-a51d-93745d09bedd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:16.400879 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a8b4f7f5-85e0-4a40-a51d-93745d09bedd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:16.464740 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2bc00aea-30db-4f63-9ccb-13daa7588f51 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:16.472668 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2bc00aea-30db-4f63-9ccb-13daa7588f51 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.184168 Oct 13 04:22:16.473402 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 368/744] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:16 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:22:16.479926 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a8b4f7f5-85e0-4a40-a51d-93745d09bedd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "POST /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/action" status: 202 len: 0 microversion: 2.1 time: 0.091922 Oct 13 04:22:16.480576 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 377/745] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:22:16 2021] POST /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:22:16.488287 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-267d8408-dc76-4dd5-a56c-12e69202fef5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:16.488890 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-267d8408-dc76-4dd5-a56c-12e69202fef5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:16.494796 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-267d8408-dc76-4dd5-a56c-12e69202fef5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:16.495240 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-267d8408-dc76-4dd5-a56c-12e69202fef5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:16.495995 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-267d8408-dc76-4dd5-a56c-12e69202fef5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:16.496420 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-267d8408-dc76-4dd5-a56c-12e69202fef5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:16.631251 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-267d8408-dc76-4dd5-a56c-12e69202fef5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:16.641876 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-267d8408-dc76-4dd5-a56c-12e69202fef5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.157063 Oct 13 04:22:16.642457 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 369/746] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:16 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:22:17.280992 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e038e036-a319-43ab-b8b1-b5d9dc7b78ce tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:17.281698 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e038e036-a319-43ab-b8b1-b5d9dc7b78ce tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:17.288853 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e038e036-a319-43ab-b8b1-b5d9dc7b78ce tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:17.289275 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e038e036-a319-43ab-b8b1-b5d9dc7b78ce tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:17.290189 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e038e036-a319-43ab-b8b1-b5d9dc7b78ce tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:17.290649 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e038e036-a319-43ab-b8b1-b5d9dc7b78ce tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:17.420069 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-e038e036-a319-43ab-b8b1-b5d9dc7b78ce tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:17.428351 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-e038e036-a319-43ab-b8b1-b5d9dc7b78ce tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:17.429883 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-e038e036-a319-43ab-b8b1-b5d9dc7b78ce tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:17.431015 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e038e036-a319-43ab-b8b1-b5d9dc7b78ce tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.154282 Oct 13 04:22:17.431563 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 378/747] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:17 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:17.489978 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-38bf6b3f-95bb-4ada-a1e2-b336d61ef34f tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:17.490552 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-38bf6b3f-95bb-4ada-a1e2-b336d61ef34f tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:17.496588 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-38bf6b3f-95bb-4ada-a1e2-b336d61ef34f tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:17.497029 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-38bf6b3f-95bb-4ada-a1e2-b336d61ef34f tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:17.497907 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-38bf6b3f-95bb-4ada-a1e2-b336d61ef34f tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:17.498322 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-38bf6b3f-95bb-4ada-a1e2-b336d61ef34f tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:17.631166 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-38bf6b3f-95bb-4ada-a1e2-b336d61ef34f tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:17.638443 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-38bf6b3f-95bb-4ada-a1e2-b336d61ef34f tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.152157 Oct 13 04:22:17.638980 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 370/748] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:17 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:17.660602 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6b6530b5-006e-4795-96ce-fec01c2cbf55 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:17.661203 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6b6530b5-006e-4795-96ce-fec01c2cbf55 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:17.667619 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6b6530b5-006e-4795-96ce-fec01c2cbf55 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:17.668057 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6b6530b5-006e-4795-96ce-fec01c2cbf55 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:17.668805 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6b6530b5-006e-4795-96ce-fec01c2cbf55 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:17.669228 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6b6530b5-006e-4795-96ce-fec01c2cbf55 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:17.797410 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6b6530b5-006e-4795-96ce-fec01c2cbf55 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:17.805887 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6b6530b5-006e-4795-96ce-fec01c2cbf55 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.149254 Oct 13 04:22:17.806875 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 379/749] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:17 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:18.452831 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ce3b4ecb-cb4a-4308-aa25-89cdbd72fae8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:18.453488 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ce3b4ecb-cb4a-4308-aa25-89cdbd72fae8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:18.460755 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ce3b4ecb-cb4a-4308-aa25-89cdbd72fae8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:18.461247 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ce3b4ecb-cb4a-4308-aa25-89cdbd72fae8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:18.462132 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ce3b4ecb-cb4a-4308-aa25-89cdbd72fae8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:18.462605 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ce3b4ecb-cb4a-4308-aa25-89cdbd72fae8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:18.589548 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ce3b4ecb-cb4a-4308-aa25-89cdbd72fae8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:18.600691 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ce3b4ecb-cb4a-4308-aa25-89cdbd72fae8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:18.602512 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ce3b4ecb-cb4a-4308-aa25-89cdbd72fae8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:18.603666 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ce3b4ecb-cb4a-4308-aa25-89cdbd72fae8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.156981 Oct 13 04:22:18.604201 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 371/750] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:18 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:18.657123 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b5ce7bfc-a4dc-4371-b243-adbf9a95a12a tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:18.657892 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b5ce7bfc-a4dc-4371-b243-adbf9a95a12a tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:18.664798 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b5ce7bfc-a4dc-4371-b243-adbf9a95a12a tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:18.665820 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b5ce7bfc-a4dc-4371-b243-adbf9a95a12a tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:18.666591 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b5ce7bfc-a4dc-4371-b243-adbf9a95a12a tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:18.667016 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b5ce7bfc-a4dc-4371-b243-adbf9a95a12a tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:18.790993 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b5ce7bfc-a4dc-4371-b243-adbf9a95a12a tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:18.798655 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b5ce7bfc-a4dc-4371-b243-adbf9a95a12a tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.146046 Oct 13 04:22:18.799153 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 380/751] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:18 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:18.823068 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1c71585d-0655-4b47-aee3-dbb76ee577b8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:18.823713 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1c71585d-0655-4b47-aee3-dbb76ee577b8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:18.829733 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1c71585d-0655-4b47-aee3-dbb76ee577b8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:18.830193 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1c71585d-0655-4b47-aee3-dbb76ee577b8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:18.831072 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1c71585d-0655-4b47-aee3-dbb76ee577b8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:18.831524 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1c71585d-0655-4b47-aee3-dbb76ee577b8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:18.957038 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1c71585d-0655-4b47-aee3-dbb76ee577b8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:18.968843 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1c71585d-0655-4b47-aee3-dbb76ee577b8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.149521 Oct 13 04:22:18.969834 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 372/752] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:18 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:19.626265 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-41585f9e-b0ff-4d3e-9718-981d4b9df8f5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:19.627828 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-41585f9e-b0ff-4d3e-9718-981d4b9df8f5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:19.638588 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-41585f9e-b0ff-4d3e-9718-981d4b9df8f5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:19.639292 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-41585f9e-b0ff-4d3e-9718-981d4b9df8f5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:19.640581 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-41585f9e-b0ff-4d3e-9718-981d4b9df8f5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:19.641325 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-41585f9e-b0ff-4d3e-9718-981d4b9df8f5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:19.766737 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-41585f9e-b0ff-4d3e-9718-981d4b9df8f5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:19.774905 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-41585f9e-b0ff-4d3e-9718-981d4b9df8f5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:19.776375 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-41585f9e-b0ff-4d3e-9718-981d4b9df8f5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:19.777512 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-41585f9e-b0ff-4d3e-9718-981d4b9df8f5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.157610 Oct 13 04:22:19.778064 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 381/753] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:19 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:19.818372 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-75ea4242-05f1-46ac-8c5d-c484f102b070 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:19.818940 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-75ea4242-05f1-46ac-8c5d-c484f102b070 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:19.828713 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-75ea4242-05f1-46ac-8c5d-c484f102b070 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:19.829582 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-75ea4242-05f1-46ac-8c5d-c484f102b070 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:19.830368 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-75ea4242-05f1-46ac-8c5d-c484f102b070 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:19.830792 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-75ea4242-05f1-46ac-8c5d-c484f102b070 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:19.958686 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-75ea4242-05f1-46ac-8c5d-c484f102b070 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:19.965906 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-75ea4242-05f1-46ac-8c5d-c484f102b070 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.153751 Oct 13 04:22:19.966447 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 373/754] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:19 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:22:19.992189 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5e33d421-e20a-4dc7-82f0-18407f0224bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:19.992793 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5e33d421-e20a-4dc7-82f0-18407f0224bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:19.999103 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5e33d421-e20a-4dc7-82f0-18407f0224bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:19.999541 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5e33d421-e20a-4dc7-82f0-18407f0224bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:20.000304 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5e33d421-e20a-4dc7-82f0-18407f0224bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:20.000814 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5e33d421-e20a-4dc7-82f0-18407f0224bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:20.122984 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5e33d421-e20a-4dc7-82f0-18407f0224bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:20.130991 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5e33d421-e20a-4dc7-82f0-18407f0224bd tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.142508 Oct 13 04:22:20.131913 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 382/755] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:19 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:20.796700 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ae1057d9-b3bf-4032-b67c-466b37d9f77b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:20.797298 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ae1057d9-b3bf-4032-b67c-466b37d9f77b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:20.804202 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ae1057d9-b3bf-4032-b67c-466b37d9f77b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:20.804618 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ae1057d9-b3bf-4032-b67c-466b37d9f77b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:20.805393 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ae1057d9-b3bf-4032-b67c-466b37d9f77b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:20.805908 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ae1057d9-b3bf-4032-b67c-466b37d9f77b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:20.928760 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ae1057d9-b3bf-4032-b67c-466b37d9f77b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:20.941492 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ae1057d9-b3bf-4032-b67c-466b37d9f77b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:20.943001 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ae1057d9-b3bf-4032-b67c-466b37d9f77b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:20.944176 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ae1057d9-b3bf-4032-b67c-466b37d9f77b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.151252 Oct 13 04:22:20.944944 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 374/756] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:20 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:20.982708 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ef19e6e0-f983-44e5-a9b8-103a907f4adb tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:20.983316 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ef19e6e0-f983-44e5-a9b8-103a907f4adb tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:20.989151 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ef19e6e0-f983-44e5-a9b8-103a907f4adb tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:20.989589 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ef19e6e0-f983-44e5-a9b8-103a907f4adb tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:20.990376 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ef19e6e0-f983-44e5-a9b8-103a907f4adb tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:20.990801 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ef19e6e0-f983-44e5-a9b8-103a907f4adb tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:21.116548 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-ef19e6e0-f983-44e5-a9b8-103a907f4adb tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:21.124266 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ef19e6e0-f983-44e5-a9b8-103a907f4adb tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.145252 Oct 13 04:22:21.124832 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 383/757] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:20 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:21.152854 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-09bbd9de-cfeb-4bea-97a6-15028624d165 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:21.153724 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-09bbd9de-cfeb-4bea-97a6-15028624d165 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:21.163093 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-09bbd9de-cfeb-4bea-97a6-15028624d165 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:21.163658 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-09bbd9de-cfeb-4bea-97a6-15028624d165 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:21.164793 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-09bbd9de-cfeb-4bea-97a6-15028624d165 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:21.165406 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-09bbd9de-cfeb-4bea-97a6-15028624d165 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:21.291531 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-09bbd9de-cfeb-4bea-97a6-15028624d165 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:21.299383 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-09bbd9de-cfeb-4bea-97a6-15028624d165 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.152401 Oct 13 04:22:21.299956 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 375/758] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:21 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:21.962875 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-af911102-28b1-43a2-9532-b30f19ff9127 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:21.963473 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-af911102-28b1-43a2-9532-b30f19ff9127 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:21.969952 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-af911102-28b1-43a2-9532-b30f19ff9127 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:21.970397 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-af911102-28b1-43a2-9532-b30f19ff9127 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:21.971161 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-af911102-28b1-43a2-9532-b30f19ff9127 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:21.971588 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-af911102-28b1-43a2-9532-b30f19ff9127 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:22.116250 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-af911102-28b1-43a2-9532-b30f19ff9127 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:22.128805 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-af911102-28b1-43a2-9532-b30f19ff9127 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:22.131260 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-af911102-28b1-43a2-9532-b30f19ff9127 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:22.133035 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-af911102-28b1-43a2-9532-b30f19ff9127 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.173734 Oct 13 04:22:22.133900 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 384/759] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:21 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:22.143107 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e378f8b1-eb51-488e-8a97-8f4c3ba7a4a1 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:22.143680 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e378f8b1-eb51-488e-8a97-8f4c3ba7a4a1 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:22.149574 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e378f8b1-eb51-488e-8a97-8f4c3ba7a4a1 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:22.150078 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e378f8b1-eb51-488e-8a97-8f4c3ba7a4a1 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:22.150827 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e378f8b1-eb51-488e-8a97-8f4c3ba7a4a1 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:22.151250 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e378f8b1-eb51-488e-8a97-8f4c3ba7a4a1 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:22.287244 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-e378f8b1-eb51-488e-8a97-8f4c3ba7a4a1 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:22.295117 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e378f8b1-eb51-488e-8a97-8f4c3ba7a4a1 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.157816 Oct 13 04:22:22.295656 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 376/760] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:22 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:22.316079 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9dfb663a-da09-4736-a9f6-9664548aeb7a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:22.316679 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9dfb663a-da09-4736-a9f6-9664548aeb7a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:22.322715 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9dfb663a-da09-4736-a9f6-9664548aeb7a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:22.323153 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9dfb663a-da09-4736-a9f6-9664548aeb7a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:22.323910 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9dfb663a-da09-4736-a9f6-9664548aeb7a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:22.324328 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9dfb663a-da09-4736-a9f6-9664548aeb7a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:22.456963 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-9dfb663a-da09-4736-a9f6-9664548aeb7a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:22.464724 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9dfb663a-da09-4736-a9f6-9664548aeb7a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.152385 Oct 13 04:22:22.465276 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 385/761] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:22 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:23.158727 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ec5c7454-b011-49d5-a06f-034c505b238e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:23.160088 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ec5c7454-b011-49d5-a06f-034c505b238e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:23.166224 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ec5c7454-b011-49d5-a06f-034c505b238e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:23.166660 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ec5c7454-b011-49d5-a06f-034c505b238e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:23.167437 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ec5c7454-b011-49d5-a06f-034c505b238e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:23.167864 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ec5c7454-b011-49d5-a06f-034c505b238e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:23.311941 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d1502f5a-dd1b-430b-b0f7-1ff72185a26e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:23.312641 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d1502f5a-dd1b-430b-b0f7-1ff72185a26e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:23.333168 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d1502f5a-dd1b-430b-b0f7-1ff72185a26e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:23.333528 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d1502f5a-dd1b-430b-b0f7-1ff72185a26e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:23.334335 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d1502f5a-dd1b-430b-b0f7-1ff72185a26e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:23.334763 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d1502f5a-dd1b-430b-b0f7-1ff72185a26e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:23.422705 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ec5c7454-b011-49d5-a06f-034c505b238e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:23.431044 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ec5c7454-b011-49d5-a06f-034c505b238e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:23.432577 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ec5c7454-b011-49d5-a06f-034c505b238e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:23.433832 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ec5c7454-b011-49d5-a06f-034c505b238e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.281404 Oct 13 04:22:23.434463 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 377/762] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:23 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:23.483231 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-80793553-41ca-4788-ab9c-1de9f8e36095 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:23.484007 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-80793553-41ca-4788-ab9c-1de9f8e36095 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:23.490485 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-80793553-41ca-4788-ab9c-1de9f8e36095 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:23.491082 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-80793553-41ca-4788-ab9c-1de9f8e36095 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:23.492043 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-80793553-41ca-4788-ab9c-1de9f8e36095 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:23.492474 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-80793553-41ca-4788-ab9c-1de9f8e36095 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:23.537458 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d1502f5a-dd1b-430b-b0f7-1ff72185a26e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:23.545349 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d1502f5a-dd1b-430b-b0f7-1ff72185a26e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.237014 Oct 13 04:22:23.545956 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 386/763] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:23 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:22:23.632520 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-80793553-41ca-4788-ab9c-1de9f8e36095 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:23.644570 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-80793553-41ca-4788-ab9c-1de9f8e36095 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.165628 Oct 13 04:22:23.645379 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 378/764] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:23 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:24.452459 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c6f8bf63-31cd-467e-b5a8-3815352c1149 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:24.453120 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c6f8bf63-31cd-467e-b5a8-3815352c1149 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:24.458974 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c6f8bf63-31cd-467e-b5a8-3815352c1149 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:24.459408 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c6f8bf63-31cd-467e-b5a8-3815352c1149 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:24.460157 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c6f8bf63-31cd-467e-b5a8-3815352c1149 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:24.460573 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c6f8bf63-31cd-467e-b5a8-3815352c1149 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:24.563174 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-cc32374e-0dc4-41ef-a8b1-506a90cfc7f7 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:24.563787 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-cc32374e-0dc4-41ef-a8b1-506a90cfc7f7 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:24.570367 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cc32374e-0dc4-41ef-a8b1-506a90cfc7f7 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:24.570810 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cc32374e-0dc4-41ef-a8b1-506a90cfc7f7 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:24.571723 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cc32374e-0dc4-41ef-a8b1-506a90cfc7f7 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:24.571998 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cc32374e-0dc4-41ef-a8b1-506a90cfc7f7 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:24.600796 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-c6f8bf63-31cd-467e-b5a8-3815352c1149 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:24.610744 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-c6f8bf63-31cd-467e-b5a8-3815352c1149 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:24.612824 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-c6f8bf63-31cd-467e-b5a8-3815352c1149 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:24.614723 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c6f8bf63-31cd-467e-b5a8-3815352c1149 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.166102 Oct 13 04:22:24.615536 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 387/765] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:24 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:24.662573 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f4e431fe-ed7b-4f9b-a5fc-a074d375504e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:24.663181 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f4e431fe-ed7b-4f9b-a5fc-a074d375504e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:24.668891 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f4e431fe-ed7b-4f9b-a5fc-a074d375504e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:24.669366 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f4e431fe-ed7b-4f9b-a5fc-a074d375504e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:24.670158 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f4e431fe-ed7b-4f9b-a5fc-a074d375504e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:24.670582 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f4e431fe-ed7b-4f9b-a5fc-a074d375504e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:24.722552 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-cc32374e-0dc4-41ef-a8b1-506a90cfc7f7 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:24.730012 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-cc32374e-0dc4-41ef-a8b1-506a90cfc7f7 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.170910 Oct 13 04:22:24.730657 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 379/766] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:24 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:24.800661 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f4e431fe-ed7b-4f9b-a5fc-a074d375504e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:24.809268 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f4e431fe-ed7b-4f9b-a5fc-a074d375504e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.150872 Oct 13 04:22:24.814728 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 388/767] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:24 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:22:25.227637 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 04:22:25.227999 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: Wed Oct 13 04:22:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 13 04:22:25.636643 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-57fc8363-8f6a-4dab-ad45-b2bc8d65533f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:25.637271 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-57fc8363-8f6a-4dab-ad45-b2bc8d65533f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:25.645865 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-57fc8363-8f6a-4dab-ad45-b2bc8d65533f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:25.646303 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-57fc8363-8f6a-4dab-ad45-b2bc8d65533f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:25.647048 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-57fc8363-8f6a-4dab-ad45-b2bc8d65533f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:25.647463 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-57fc8363-8f6a-4dab-ad45-b2bc8d65533f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:25.746916 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1cba1a14-3bb0-49ca-b0ed-7c2de986ecae tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:25.748107 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-1cba1a14-3bb0-49ca-b0ed-7c2de986ecae tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:25.756154 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1cba1a14-3bb0-49ca-b0ed-7c2de986ecae tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:25.756926 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1cba1a14-3bb0-49ca-b0ed-7c2de986ecae tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:25.757955 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1cba1a14-3bb0-49ca-b0ed-7c2de986ecae tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:25.758588 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1cba1a14-3bb0-49ca-b0ed-7c2de986ecae tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:25.786575 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-57fc8363-8f6a-4dab-ad45-b2bc8d65533f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:25.796065 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-57fc8363-8f6a-4dab-ad45-b2bc8d65533f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:25.797987 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-57fc8363-8f6a-4dab-ad45-b2bc8d65533f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:25.799610 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-57fc8363-8f6a-4dab-ad45-b2bc8d65533f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.168909 Oct 13 04:22:25.800748 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 380/768] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:25 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:25.827697 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7db0e9da-f65c-4128-ade1-8c91e001e057 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:25.828527 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7db0e9da-f65c-4128-ade1-8c91e001e057 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:25.837665 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7db0e9da-f65c-4128-ade1-8c91e001e057 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:25.837665 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7db0e9da-f65c-4128-ade1-8c91e001e057 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:25.837665 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7db0e9da-f65c-4128-ade1-8c91e001e057 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:25.837665 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7db0e9da-f65c-4128-ade1-8c91e001e057 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:25.921064 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-1cba1a14-3bb0-49ca-b0ed-7c2de986ecae tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:25.929224 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-1cba1a14-3bb0-49ca-b0ed-7c2de986ecae tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.186068 Oct 13 04:22:25.933146 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 389/769] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:25 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:22:25.986180 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-7db0e9da-f65c-4128-ade1-8c91e001e057 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:25.994060 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7db0e9da-f65c-4128-ade1-8c91e001e057 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.170262 Oct 13 04:22:25.994628 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 381/770] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:25 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:22:26.819226 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5dd40486-b3e5-4e64-a138-17e0900e036f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:26.819936 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5dd40486-b3e5-4e64-a138-17e0900e036f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:26.826163 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5dd40486-b3e5-4e64-a138-17e0900e036f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:26.826841 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5dd40486-b3e5-4e64-a138-17e0900e036f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:26.827738 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5dd40486-b3e5-4e64-a138-17e0900e036f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:26.828279 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5dd40486-b3e5-4e64-a138-17e0900e036f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:26.950656 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c8759be9-414f-4059-8d2d-fdcc0fb66e47 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:26.951291 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c8759be9-414f-4059-8d2d-fdcc0fb66e47 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:26.955525 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5dd40486-b3e5-4e64-a138-17e0900e036f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:26.957337 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c8759be9-414f-4059-8d2d-fdcc0fb66e47 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:26.957810 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c8759be9-414f-4059-8d2d-fdcc0fb66e47 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:26.958680 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c8759be9-414f-4059-8d2d-fdcc0fb66e47 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:26.959109 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c8759be9-414f-4059-8d2d-fdcc0fb66e47 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:26.964208 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5dd40486-b3e5-4e64-a138-17e0900e036f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:26.965722 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5dd40486-b3e5-4e64-a138-17e0900e036f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:26.966876 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5dd40486-b3e5-4e64-a138-17e0900e036f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.151742 Oct 13 04:22:26.967439 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 390/771] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:26 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:27.010292 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-247bfe11-a68c-4577-a8de-80258e7f363b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:27.010883 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-247bfe11-a68c-4577-a8de-80258e7f363b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:27.016919 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-247bfe11-a68c-4577-a8de-80258e7f363b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:27.017354 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-247bfe11-a68c-4577-a8de-80258e7f363b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:27.018142 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-247bfe11-a68c-4577-a8de-80258e7f363b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:27.018568 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-247bfe11-a68c-4577-a8de-80258e7f363b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:27.115919 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c8759be9-414f-4059-8d2d-fdcc0fb66e47 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:27.123206 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c8759be9-414f-4059-8d2d-fdcc0fb66e47 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.176577 Oct 13 04:22:27.123780 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 382/772] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:26 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:27.165532 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-247bfe11-a68c-4577-a8de-80258e7f363b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:27.173173 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-247bfe11-a68c-4577-a8de-80258e7f363b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.166563 Oct 13 04:22:27.173952 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 391/773] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:27 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:27.986377 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3d8feeac-e3b8-46eb-b0e2-c93051b2574a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:27.987116 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3d8feeac-e3b8-46eb-b0e2-c93051b2574a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:27.993881 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3d8feeac-e3b8-46eb-b0e2-c93051b2574a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:27.994331 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3d8feeac-e3b8-46eb-b0e2-c93051b2574a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:27.995354 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3d8feeac-e3b8-46eb-b0e2-c93051b2574a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:27.995784 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3d8feeac-e3b8-46eb-b0e2-c93051b2574a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:28.120203 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-3d8feeac-e3b8-46eb-b0e2-c93051b2574a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:28.128611 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-3d8feeac-e3b8-46eb-b0e2-c93051b2574a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:28.130112 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-3d8feeac-e3b8-46eb-b0e2-c93051b2574a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:28.131293 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3d8feeac-e3b8-46eb-b0e2-c93051b2574a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.149720 Oct 13 04:22:28.131825 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 383/774] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:27 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:28.141178 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3c6b58a8-930c-4b51-9738-06dbc01b84aa tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:28.141839 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3c6b58a8-930c-4b51-9738-06dbc01b84aa tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:28.148920 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3c6b58a8-930c-4b51-9738-06dbc01b84aa tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:28.149356 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3c6b58a8-930c-4b51-9738-06dbc01b84aa tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:28.150215 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3c6b58a8-930c-4b51-9738-06dbc01b84aa tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:28.150640 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3c6b58a8-930c-4b51-9738-06dbc01b84aa tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:28.190219 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b3e49194-bb51-4831-836e-f6d1b6a34460 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:28.190819 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b3e49194-bb51-4831-836e-f6d1b6a34460 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:28.196914 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b3e49194-bb51-4831-836e-f6d1b6a34460 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:28.197363 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b3e49194-bb51-4831-836e-f6d1b6a34460 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:28.198160 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b3e49194-bb51-4831-836e-f6d1b6a34460 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:28.198585 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b3e49194-bb51-4831-836e-f6d1b6a34460 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:28.296193 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-3c6b58a8-930c-4b51-9738-06dbc01b84aa tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:28.303930 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3c6b58a8-930c-4b51-9738-06dbc01b84aa tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.166936 Oct 13 04:22:28.306080 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 392/775] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:28 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:28.348997 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b3e49194-bb51-4831-836e-f6d1b6a34460 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:28.357442 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b3e49194-bb51-4831-836e-f6d1b6a34460 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.170746 Oct 13 04:22:28.358275 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 384/776] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:28 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:22:29.150490 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-fce4c72c-530f-4f49-8d7c-3146b5c0dcd3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:29.151112 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-fce4c72c-530f-4f49-8d7c-3146b5c0dcd3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:29.157292 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fce4c72c-530f-4f49-8d7c-3146b5c0dcd3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:29.157820 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fce4c72c-530f-4f49-8d7c-3146b5c0dcd3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:29.158573 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fce4c72c-530f-4f49-8d7c-3146b5c0dcd3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:29.159350 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fce4c72c-530f-4f49-8d7c-3146b5c0dcd3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:29.297766 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-fce4c72c-530f-4f49-8d7c-3146b5c0dcd3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:29.306078 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-fce4c72c-530f-4f49-8d7c-3146b5c0dcd3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:29.307576 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-fce4c72c-530f-4f49-8d7c-3146b5c0dcd3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:29.308729 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-fce4c72c-530f-4f49-8d7c-3146b5c0dcd3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.162531 Oct 13 04:22:29.309261 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 393/777] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:29 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:29.320243 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3d08e481-a656-4f40-a7a7-89ec6dfd9020 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:29.320845 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3d08e481-a656-4f40-a7a7-89ec6dfd9020 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:29.327208 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3d08e481-a656-4f40-a7a7-89ec6dfd9020 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:29.327591 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3d08e481-a656-4f40-a7a7-89ec6dfd9020 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:29.328355 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3d08e481-a656-4f40-a7a7-89ec6dfd9020 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:29.328772 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3d08e481-a656-4f40-a7a7-89ec6dfd9020 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:29.379751 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b002e84b-37bd-420b-938f-9907b293fc6e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:29.380390 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b002e84b-37bd-420b-938f-9907b293fc6e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:29.390093 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b002e84b-37bd-420b-938f-9907b293fc6e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:29.391410 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b002e84b-37bd-420b-938f-9907b293fc6e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:29.392458 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b002e84b-37bd-420b-938f-9907b293fc6e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:29.393092 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b002e84b-37bd-420b-938f-9907b293fc6e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:29.479211 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-3d08e481-a656-4f40-a7a7-89ec6dfd9020 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:29.486554 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3d08e481-a656-4f40-a7a7-89ec6dfd9020 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.170168 Oct 13 04:22:29.487109 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 385/778] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:29 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:29.537174 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b002e84b-37bd-420b-938f-9907b293fc6e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:29.550240 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b002e84b-37bd-420b-938f-9907b293fc6e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.178556 Oct 13 04:22:29.551180 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 394/779] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:29 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:30.332088 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-de9f3dc8-fa15-45e5-a613-dfbedc6a594b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:30.333474 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-de9f3dc8-fa15-45e5-a613-dfbedc6a594b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:30.354730 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-de9f3dc8-fa15-45e5-a613-dfbedc6a594b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:30.355164 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-de9f3dc8-fa15-45e5-a613-dfbedc6a594b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:30.357261 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-de9f3dc8-fa15-45e5-a613-dfbedc6a594b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:30.357977 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-de9f3dc8-fa15-45e5-a613-dfbedc6a594b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:30.492249 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-de9f3dc8-fa15-45e5-a613-dfbedc6a594b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:30.501769 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-de9f3dc8-fa15-45e5-a613-dfbedc6a594b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:30.503270 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-de9f3dc8-fa15-45e5-a613-dfbedc6a594b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:30.503482 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5c2f8203-5aab-4af9-a913-ac8e255e528d tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:30.504076 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5c2f8203-5aab-4af9-a913-ac8e255e528d tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:30.504429 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-de9f3dc8-fa15-45e5-a613-dfbedc6a594b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.176371 Oct 13 04:22:30.505291 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 386/780] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:30 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:30.513207 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5c2f8203-5aab-4af9-a913-ac8e255e528d tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:30.513207 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5c2f8203-5aab-4af9-a913-ac8e255e528d tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:30.513207 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5c2f8203-5aab-4af9-a913-ac8e255e528d tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:30.513207 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5c2f8203-5aab-4af9-a913-ac8e255e528d tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:30.567534 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7920ff02-235e-4012-9699-045bb85d754b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:30.568217 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7920ff02-235e-4012-9699-045bb85d754b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:30.574361 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7920ff02-235e-4012-9699-045bb85d754b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:30.574841 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7920ff02-235e-4012-9699-045bb85d754b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:30.575612 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7920ff02-235e-4012-9699-045bb85d754b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:30.576042 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7920ff02-235e-4012-9699-045bb85d754b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:30.664814 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5c2f8203-5aab-4af9-a913-ac8e255e528d tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:30.673197 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5c2f8203-5aab-4af9-a913-ac8e255e528d tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.173269 Oct 13 04:22:30.683415 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 395/781] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:30 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:30.733405 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-7920ff02-235e-4012-9699-045bb85d754b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:30.743024 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7920ff02-235e-4012-9699-045bb85d754b tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.179204 Oct 13 04:22:30.743635 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 387/782] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:30 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:22:31.523314 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e2708fc3-4798-4043-85bb-b781f0320eca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:31.523934 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e2708fc3-4798-4043-85bb-b781f0320eca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:31.530037 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e2708fc3-4798-4043-85bb-b781f0320eca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:31.530481 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e2708fc3-4798-4043-85bb-b781f0320eca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:31.531276 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e2708fc3-4798-4043-85bb-b781f0320eca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:31.531705 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e2708fc3-4798-4043-85bb-b781f0320eca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:31.655593 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-e2708fc3-4798-4043-85bb-b781f0320eca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:31.665164 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-e2708fc3-4798-4043-85bb-b781f0320eca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:31.666815 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-e2708fc3-4798-4043-85bb-b781f0320eca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:31.668067 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e2708fc3-4798-4043-85bb-b781f0320eca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.148751 Oct 13 04:22:31.669083 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 396/783] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:31 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 04:22:31.690109 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0c951d64-35c0-4300-9182-36f98880cdb0 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:31.690764 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0c951d64-35c0-4300-9182-36f98880cdb0 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:31.696825 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0c951d64-35c0-4300-9182-36f98880cdb0 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:31.697270 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0c951d64-35c0-4300-9182-36f98880cdb0 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:31.698094 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0c951d64-35c0-4300-9182-36f98880cdb0 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:31.698777 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0c951d64-35c0-4300-9182-36f98880cdb0 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:31.760420 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-707f5a05-7283-4599-82de-8d5c9dadccf7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:31.760965 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-707f5a05-7283-4599-82de-8d5c9dadccf7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:31.769627 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-707f5a05-7283-4599-82de-8d5c9dadccf7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:31.770040 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-707f5a05-7283-4599-82de-8d5c9dadccf7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:31.770805 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-707f5a05-7283-4599-82de-8d5c9dadccf7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:31.771219 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-707f5a05-7283-4599-82de-8d5c9dadccf7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:31.854691 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-0c951d64-35c0-4300-9182-36f98880cdb0 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:31.863402 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0c951d64-35c0-4300-9182-36f98880cdb0 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.176941 Oct 13 04:22:31.864269 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 388/784] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:31 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:31.910910 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-707f5a05-7283-4599-82de-8d5c9dadccf7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:31.918727 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-707f5a05-7283-4599-82de-8d5c9dadccf7 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.162291 Oct 13 04:22:31.919288 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 397/785] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:31 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:32.689942 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b821f70a-97f1-499e-8cf6-9299c85d6629 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:32.690922 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b821f70a-97f1-499e-8cf6-9299c85d6629 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:32.698870 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b821f70a-97f1-499e-8cf6-9299c85d6629 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:32.699310 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b821f70a-97f1-499e-8cf6-9299c85d6629 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:32.700053 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b821f70a-97f1-499e-8cf6-9299c85d6629 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:32.700469 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b821f70a-97f1-499e-8cf6-9299c85d6629 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:32.833316 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b821f70a-97f1-499e-8cf6-9299c85d6629 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:32.845515 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b821f70a-97f1-499e-8cf6-9299c85d6629 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:32.847843 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b821f70a-97f1-499e-8cf6-9299c85d6629 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:32.849803 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b821f70a-97f1-499e-8cf6-9299c85d6629 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.165871 Oct 13 04:22:32.850644 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 389/786] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:32 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:32.883524 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f936caa0-b78d-4c65-b162-a102e836368d tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:32.884081 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f936caa0-b78d-4c65-b162-a102e836368d tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:32.893438 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f936caa0-b78d-4c65-b162-a102e836368d tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:32.894042 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f936caa0-b78d-4c65-b162-a102e836368d tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:32.895215 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f936caa0-b78d-4c65-b162-a102e836368d tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:32.895775 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f936caa0-b78d-4c65-b162-a102e836368d tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:32.935828 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3b0de808-0d10-417c-aff3-5bfb4d71ed18 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:32.936588 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3b0de808-0d10-417c-aff3-5bfb4d71ed18 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:32.943290 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3b0de808-0d10-417c-aff3-5bfb4d71ed18 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:32.943727 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3b0de808-0d10-417c-aff3-5bfb4d71ed18 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:32.944488 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3b0de808-0d10-417c-aff3-5bfb4d71ed18 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:32.944926 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3b0de808-0d10-417c-aff3-5bfb4d71ed18 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:33.048426 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f936caa0-b78d-4c65-b162-a102e836368d tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:33.056453 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f936caa0-b78d-4c65-b162-a102e836368d tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.178850 Oct 13 04:22:33.057008 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 398/787] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:32 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:33.094571 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-3b0de808-0d10-417c-aff3-5bfb4d71ed18 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:33.102463 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3b0de808-0d10-417c-aff3-5bfb4d71ed18 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.170374 Oct 13 04:22:33.103027 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 390/788] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:32 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:33.870648 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-759d578f-72d0-49fd-a8d9-114cd1ba9380 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:33.871168 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-759d578f-72d0-49fd-a8d9-114cd1ba9380 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:33.877540 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-759d578f-72d0-49fd-a8d9-114cd1ba9380 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:33.878021 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-759d578f-72d0-49fd-a8d9-114cd1ba9380 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:33.878783 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-759d578f-72d0-49fd-a8d9-114cd1ba9380 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:33.879212 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-759d578f-72d0-49fd-a8d9-114cd1ba9380 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:34.010230 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-759d578f-72d0-49fd-a8d9-114cd1ba9380 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:34.019172 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-759d578f-72d0-49fd-a8d9-114cd1ba9380 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:34.020635 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-759d578f-72d0-49fd-a8d9-114cd1ba9380 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:34.021836 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-759d578f-72d0-49fd-a8d9-114cd1ba9380 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.155674 Oct 13 04:22:34.022383 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 399/789] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:33 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:34.073000 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ad30565f-a814-4e69-9d93-2338aaf3a595 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:34.073546 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ad30565f-a814-4e69-9d93-2338aaf3a595 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:34.080454 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ad30565f-a814-4e69-9d93-2338aaf3a595 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:34.080896 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ad30565f-a814-4e69-9d93-2338aaf3a595 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:34.081705 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ad30565f-a814-4e69-9d93-2338aaf3a595 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:34.082135 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ad30565f-a814-4e69-9d93-2338aaf3a595 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:34.121863 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4af81683-c686-4846-a0ea-f867a2fb04ed tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:34.122518 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4af81683-c686-4846-a0ea-f867a2fb04ed tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:34.130756 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4af81683-c686-4846-a0ea-f867a2fb04ed tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:34.131168 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4af81683-c686-4846-a0ea-f867a2fb04ed tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:34.132359 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4af81683-c686-4846-a0ea-f867a2fb04ed tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:34.132933 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4af81683-c686-4846-a0ea-f867a2fb04ed tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:34.240628 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ad30565f-a814-4e69-9d93-2338aaf3a595 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:34.247948 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ad30565f-a814-4e69-9d93-2338aaf3a595 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.178816 Oct 13 04:22:34.248509 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 391/790] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:34 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:34.289704 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4af81683-c686-4846-a0ea-f867a2fb04ed tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:34.297864 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4af81683-c686-4846-a0ea-f867a2fb04ed tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.181813 Oct 13 04:22:34.298433 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 400/791] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:34 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:35.048302 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c47e5bcf-4edc-4f63-adbd-c48e25a8ae6d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:35.048996 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c47e5bcf-4edc-4f63-adbd-c48e25a8ae6d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:35.056407 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c47e5bcf-4edc-4f63-adbd-c48e25a8ae6d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:35.056922 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c47e5bcf-4edc-4f63-adbd-c48e25a8ae6d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:35.057931 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c47e5bcf-4edc-4f63-adbd-c48e25a8ae6d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:35.058432 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c47e5bcf-4edc-4f63-adbd-c48e25a8ae6d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:35.264395 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6a4a558c-091c-4a32-a999-e5ac690d09e8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:35.265000 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6a4a558c-091c-4a32-a999-e5ac690d09e8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:35.280135 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6a4a558c-091c-4a32-a999-e5ac690d09e8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:35.280557 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6a4a558c-091c-4a32-a999-e5ac690d09e8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:35.281525 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6a4a558c-091c-4a32-a999-e5ac690d09e8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:35.281974 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6a4a558c-091c-4a32-a999-e5ac690d09e8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:35.304581 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c47e5bcf-4edc-4f63-adbd-c48e25a8ae6d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:35.313785 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c47e5bcf-4edc-4f63-adbd-c48e25a8ae6d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:35.315308 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c47e5bcf-4edc-4f63-adbd-c48e25a8ae6d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:35.316678 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c47e5bcf-4edc-4f63-adbd-c48e25a8ae6d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.272891 Oct 13 04:22:35.317260 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 392/792] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:35 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:35.321533 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-93ddc2a3-0c78-43f2-b0db-ace4e3b72bc9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:35.322152 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-93ddc2a3-0c78-43f2-b0db-ace4e3b72bc9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:35.327906 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-93ddc2a3-0c78-43f2-b0db-ace4e3b72bc9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:35.329105 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-93ddc2a3-0c78-43f2-b0db-ace4e3b72bc9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:35.329928 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-93ddc2a3-0c78-43f2-b0db-ace4e3b72bc9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:35.330370 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-93ddc2a3-0c78-43f2-b0db-ace4e3b72bc9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:35.578767 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6a4a558c-091c-4a32-a999-e5ac690d09e8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:35.586076 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6a4a558c-091c-4a32-a999-e5ac690d09e8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.325839 Oct 13 04:22:35.586625 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 401/793] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:35 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:35.597211 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-93ddc2a3-0c78-43f2-b0db-ace4e3b72bc9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:35.605788 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-93ddc2a3-0c78-43f2-b0db-ace4e3b72bc9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.287402 Oct 13 04:22:35.606609 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 393/794] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:35 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:36.338817 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-98dd54b5-b8d8-4121-b67e-c0f07ceba6c5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:36.339839 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-98dd54b5-b8d8-4121-b67e-c0f07ceba6c5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:36.349768 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-98dd54b5-b8d8-4121-b67e-c0f07ceba6c5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:36.350529 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-98dd54b5-b8d8-4121-b67e-c0f07ceba6c5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:36.351624 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-98dd54b5-b8d8-4121-b67e-c0f07ceba6c5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:36.352046 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-98dd54b5-b8d8-4121-b67e-c0f07ceba6c5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:36.480279 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-98dd54b5-b8d8-4121-b67e-c0f07ceba6c5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:36.488698 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-98dd54b5-b8d8-4121-b67e-c0f07ceba6c5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:36.490193 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-98dd54b5-b8d8-4121-b67e-c0f07ceba6c5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:36.491390 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-98dd54b5-b8d8-4121-b67e-c0f07ceba6c5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.158772 Oct 13 04:22:36.491944 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 402/795] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:36 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:36.602932 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c5b8682d-3618-4ee6-aaa1-a5655caad979 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:36.603437 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c5b8682d-3618-4ee6-aaa1-a5655caad979 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:36.609910 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c5b8682d-3618-4ee6-aaa1-a5655caad979 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:36.610350 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c5b8682d-3618-4ee6-aaa1-a5655caad979 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:36.611107 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c5b8682d-3618-4ee6-aaa1-a5655caad979 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:36.611524 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c5b8682d-3618-4ee6-aaa1-a5655caad979 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:36.622152 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-25f8f105-4fb3-4e1d-b79a-0c1a3e67beb0 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:36.622760 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-25f8f105-4fb3-4e1d-b79a-0c1a3e67beb0 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:36.628888 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-25f8f105-4fb3-4e1d-b79a-0c1a3e67beb0 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:36.629328 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-25f8f105-4fb3-4e1d-b79a-0c1a3e67beb0 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:36.630131 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-25f8f105-4fb3-4e1d-b79a-0c1a3e67beb0 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:36.630554 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-25f8f105-4fb3-4e1d-b79a-0c1a3e67beb0 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:36.783873 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c5b8682d-3618-4ee6-aaa1-a5655caad979 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:36.793746 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c5b8682d-3618-4ee6-aaa1-a5655caad979 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.194553 Oct 13 04:22:36.794525 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 394/796] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:36 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:36.797813 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-25f8f105-4fb3-4e1d-b79a-0c1a3e67beb0 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:36.808377 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-25f8f105-4fb3-4e1d-b79a-0c1a3e67beb0 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.189942 Oct 13 04:22:36.808934 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 403/797] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:36 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:37.631405 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d0745c7d-40e1-4167-b444-d583ba5d79ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:37.632030 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d0745c7d-40e1-4167-b444-d583ba5d79ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:37.637763 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0745c7d-40e1-4167-b444-d583ba5d79ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:37.638199 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0745c7d-40e1-4167-b444-d583ba5d79ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:37.638949 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0745c7d-40e1-4167-b444-d583ba5d79ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:37.639358 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d0745c7d-40e1-4167-b444-d583ba5d79ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:37.761587 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-d0745c7d-40e1-4167-b444-d583ba5d79ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:37.770246 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-d0745c7d-40e1-4167-b444-d583ba5d79ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:37.771622 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-d0745c7d-40e1-4167-b444-d583ba5d79ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:37.772760 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d0745c7d-40e1-4167-b444-d583ba5d79ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.265303 Oct 13 04:22:37.773347 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 395/798] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:37 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:37.814435 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e63a5d9a-463c-48fd-9240-033f5f75d3b7 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:37.815016 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e63a5d9a-463c-48fd-9240-033f5f75d3b7 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:37.821455 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e63a5d9a-463c-48fd-9240-033f5f75d3b7 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:37.821927 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e63a5d9a-463c-48fd-9240-033f5f75d3b7 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:37.822679 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e63a5d9a-463c-48fd-9240-033f5f75d3b7 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:37.823103 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e63a5d9a-463c-48fd-9240-033f5f75d3b7 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:37.825155 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a7871a19-e0b5-4f94-8380-c74a68b3b198 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:37.825790 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a7871a19-e0b5-4f94-8380-c74a68b3b198 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:37.831924 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a7871a19-e0b5-4f94-8380-c74a68b3b198 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:37.832375 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a7871a19-e0b5-4f94-8380-c74a68b3b198 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:37.833136 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a7871a19-e0b5-4f94-8380-c74a68b3b198 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:37.833563 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a7871a19-e0b5-4f94-8380-c74a68b3b198 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:37.994553 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-e63a5d9a-463c-48fd-9240-033f5f75d3b7 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:37.999034 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a7871a19-e0b5-4f94-8380-c74a68b3b198 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:38.002191 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e63a5d9a-463c-48fd-9240-033f5f75d3b7 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.191432 Oct 13 04:22:38.002760 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 404/799] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:37 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:38.007233 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a7871a19-e0b5-4f94-8380-c74a68b3b198 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.185494 Oct 13 04:22:38.007813 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 396/800] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:37 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:22:38.793285 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6a0ace42-79f6-4b7b-a275-569160b8c782 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:38.793942 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6a0ace42-79f6-4b7b-a275-569160b8c782 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:38.800803 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6a0ace42-79f6-4b7b-a275-569160b8c782 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:38.801336 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6a0ace42-79f6-4b7b-a275-569160b8c782 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:38.802112 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6a0ace42-79f6-4b7b-a275-569160b8c782 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:38.802561 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6a0ace42-79f6-4b7b-a275-569160b8c782 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:38.928506 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6a0ace42-79f6-4b7b-a275-569160b8c782 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:38.937384 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6a0ace42-79f6-4b7b-a275-569160b8c782 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:38.938914 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6a0ace42-79f6-4b7b-a275-569160b8c782 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:38.940081 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6a0ace42-79f6-4b7b-a275-569160b8c782 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.150822 Oct 13 04:22:38.940607 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 405/801] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:38 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:39.022936 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b888484c-d113-48ae-9295-ae208d636554 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:39.023539 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b888484c-d113-48ae-9295-ae208d636554 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:39.025724 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-497a601f-d463-4dcb-9ab9-4252f88a7f8a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:39.026295 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-497a601f-d463-4dcb-9ab9-4252f88a7f8a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:39.030054 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b888484c-d113-48ae-9295-ae208d636554 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:39.030494 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b888484c-d113-48ae-9295-ae208d636554 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:39.031264 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b888484c-d113-48ae-9295-ae208d636554 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:39.031694 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b888484c-d113-48ae-9295-ae208d636554 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:39.032300 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-497a601f-d463-4dcb-9ab9-4252f88a7f8a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:39.032737 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-497a601f-d463-4dcb-9ab9-4252f88a7f8a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:39.033905 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-497a601f-d463-4dcb-9ab9-4252f88a7f8a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:39.034326 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-497a601f-d463-4dcb-9ab9-4252f88a7f8a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:39.208737 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b888484c-d113-48ae-9295-ae208d636554 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:39.213997 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-497a601f-d463-4dcb-9ab9-4252f88a7f8a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:39.216861 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b888484c-d113-48ae-9295-ae208d636554 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.200154 Oct 13 04:22:39.217797 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 397/802] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:39 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:39.227388 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-497a601f-d463-4dcb-9ab9-4252f88a7f8a tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1554 microversion: 2.1 time: 0.205831 Oct 13 04:22:39.227989 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 406/803] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:39 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1554 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:39.962475 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0f6e42ff-a551-47d9-ae83-05361059e393 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:39.963474 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0f6e42ff-a551-47d9-ae83-05361059e393 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:39.973670 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f6e42ff-a551-47d9-ae83-05361059e393 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:39.974463 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f6e42ff-a551-47d9-ae83-05361059e393 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:39.975682 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f6e42ff-a551-47d9-ae83-05361059e393 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:39.976459 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f6e42ff-a551-47d9-ae83-05361059e393 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:40.109748 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-0f6e42ff-a551-47d9-ae83-05361059e393 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:40.118418 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-0f6e42ff-a551-47d9-ae83-05361059e393 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:40.119907 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-0f6e42ff-a551-47d9-ae83-05361059e393 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:40.121110 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0f6e42ff-a551-47d9-ae83-05361059e393 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.165132 Oct 13 04:22:40.121660 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 398/804] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:39 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:40.236219 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-66a4a0c5-e749-4c76-853c-1365313ae83e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:40.236825 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-66a4a0c5-e749-4c76-853c-1365313ae83e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:40.243320 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-66a4a0c5-e749-4c76-853c-1365313ae83e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:40.243766 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-66a4a0c5-e749-4c76-853c-1365313ae83e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:40.244039 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-25b837ba-f0d4-4e4f-90f8-58a919b7869e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:40.244532 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-66a4a0c5-e749-4c76-853c-1365313ae83e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:40.244818 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-25b837ba-f0d4-4e4f-90f8-58a919b7869e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:40.244961 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-66a4a0c5-e749-4c76-853c-1365313ae83e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:40.251487 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-25b837ba-f0d4-4e4f-90f8-58a919b7869e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:40.251935 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-25b837ba-f0d4-4e4f-90f8-58a919b7869e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:40.252712 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-25b837ba-f0d4-4e4f-90f8-58a919b7869e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:40.253151 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-25b837ba-f0d4-4e4f-90f8-58a919b7869e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:40.419764 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-66a4a0c5-e749-4c76-853c-1365313ae83e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:40.425817 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-25b837ba-f0d4-4e4f-90f8-58a919b7869e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:40.427627 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-66a4a0c5-e749-4c76-853c-1365313ae83e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.197023 Oct 13 04:22:40.428172 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 407/805] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:40 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:40.433652 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-25b837ba-f0d4-4e4f-90f8-58a919b7869e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1560 microversion: 2.1 time: 0.193215 Oct 13 04:22:40.434249 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 399/806] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:40 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:40.505934 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f681bfa4-8573-4f31-b802-af8548f977ed tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:40.506447 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f681bfa4-8573-4f31-b802-af8548f977ed tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:40.512340 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f681bfa4-8573-4f31-b802-af8548f977ed tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:40.512782 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f681bfa4-8573-4f31-b802-af8548f977ed tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:40.513578 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f681bfa4-8573-4f31-b802-af8548f977ed tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:40.514153 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f681bfa4-8573-4f31-b802-af8548f977ed tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:40.593901 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.objects.instance [None req-f681bfa4-8573-4f31-b802-af8548f977ed tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lazy-loading 'services' on Instance uuid 2b4223c8-bfe1-440e-89bc-7158a1490e1c {{(pid=108260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:22:40.664598 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f681bfa4-8573-4f31-b802-af8548f977ed tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "DELETE /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/os-volume_attachments/a05b86bd-7ba5-4743-8ad1-bf77418a7c57" status: 202 len: 0 microversion: 2.1 time: 0.162215 Oct 13 04:22:40.665163 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 408/807] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Oct 13 04:22:40 2021] DELETE /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/os-volume_attachments/a05b86bd-7ba5-4743-8ad1-bf77418a7c57 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:22:40.673395 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7b596fd0-9e21-4569-81e2-ee7ffbdd4ce5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:40.674402 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7b596fd0-9e21-4569-81e2-ee7ffbdd4ce5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:40.680428 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7b596fd0-9e21-4569-81e2-ee7ffbdd4ce5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:40.680987 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7b596fd0-9e21-4569-81e2-ee7ffbdd4ce5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:40.681719 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7b596fd0-9e21-4569-81e2-ee7ffbdd4ce5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:40.682211 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7b596fd0-9e21-4569-81e2-ee7ffbdd4ce5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:40.711772 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7b596fd0-9e21-4569-81e2-ee7ffbdd4ce5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042081 Oct 13 04:22:40.712339 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 400/808] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:22:40 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:22:41.150905 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f6c9955e-455d-40b7-9ba6-32f3656edac9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:41.152021 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f6c9955e-455d-40b7-9ba6-32f3656edac9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:41.163344 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f6c9955e-455d-40b7-9ba6-32f3656edac9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:41.164062 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f6c9955e-455d-40b7-9ba6-32f3656edac9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:41.165310 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f6c9955e-455d-40b7-9ba6-32f3656edac9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:41.166049 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f6c9955e-455d-40b7-9ba6-32f3656edac9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:41.302096 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f6c9955e-455d-40b7-9ba6-32f3656edac9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:41.310890 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f6c9955e-455d-40b7-9ba6-32f3656edac9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:41.312364 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f6c9955e-455d-40b7-9ba6-32f3656edac9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:41.313522 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f6c9955e-455d-40b7-9ba6-32f3656edac9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.169687 Oct 13 04:22:41.314119 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 409/809] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:41 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:41.444322 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c112a582-f488-496a-8410-cf8959fd8064 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:41.444944 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c112a582-f488-496a-8410-cf8959fd8064 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:41.451876 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c112a582-f488-496a-8410-cf8959fd8064 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:41.452321 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c112a582-f488-496a-8410-cf8959fd8064 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:41.453088 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c112a582-f488-496a-8410-cf8959fd8064 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:41.453599 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c112a582-f488-496a-8410-cf8959fd8064 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:41.661003 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c112a582-f488-496a-8410-cf8959fd8064 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:41.670072 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c112a582-f488-496a-8410-cf8959fd8064 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.229468 Oct 13 04:22:41.670948 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 401/810] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:41 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:41.728440 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-bc6cacda-6f3e-4e56-a935-1d513d66449e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:41.729425 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-bc6cacda-6f3e-4e56-a935-1d513d66449e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:41.731230 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-0ab4cc83-7393-4786-9f69-05f1a4cfb54f req-440612a3-ac73-43b5-80fd-9cc4d2bab6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39ca441-9306-4e97-8dee-e2ae3367c0dc", "name": "network-vif-plugged", "status": "completed", "tag": "6a971d86-b9a8-4230-9244-991803f191ba"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:22:41.733030 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:22:41.733030 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:22:41.745528 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bc6cacda-6f3e-4e56-a935-1d513d66449e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:41.746384 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bc6cacda-6f3e-4e56-a935-1d513d66449e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:41.748320 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-0ab4cc83-7393-4786-9f69-05f1a4cfb54f req-440612a3-ac73-43b5-80fd-9cc4d2bab6e7 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:41.748761 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-0ab4cc83-7393-4786-9f69-05f1a4cfb54f req-440612a3-ac73-43b5-80fd-9cc4d2bab6e7 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:41.753203 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bc6cacda-6f3e-4e56-a935-1d513d66449e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:41.753677 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bc6cacda-6f3e-4e56-a935-1d513d66449e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:41.765097 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-0ab4cc83-7393-4786-9f69-05f1a4cfb54f req-440612a3-ac73-43b5-80fd-9cc4d2bab6e7 service nova] Creating event network-vif-plugged:6a971d86-b9a8-4230-9244-991803f191ba for instance e39ca441-9306-4e97-8dee-e2ae3367c0dc on hv-cinder-81275 Oct 13 04:22:41.771253 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-0ab4cc83-7393-4786-9f69-05f1a4cfb54f req-440612a3-ac73-43b5-80fd-9cc4d2bab6e7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048216 Oct 13 04:22:41.772563 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 402/811] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:22:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:22:41.796069 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-bc6cacda-6f3e-4e56-a935-1d513d66449e tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075902 Oct 13 04:22:41.809744 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 410/812] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:22:41 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:22:42.335659 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a30bc39f-7bfe-4260-b364-6f8db2799229 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:42.336720 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a30bc39f-7bfe-4260-b364-6f8db2799229 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:42.346807 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a30bc39f-7bfe-4260-b364-6f8db2799229 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:42.347463 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a30bc39f-7bfe-4260-b364-6f8db2799229 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:42.348532 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a30bc39f-7bfe-4260-b364-6f8db2799229 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:42.349113 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a30bc39f-7bfe-4260-b364-6f8db2799229 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:42.481821 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a30bc39f-7bfe-4260-b364-6f8db2799229 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:42.494794 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a30bc39f-7bfe-4260-b364-6f8db2799229 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:42.497105 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a30bc39f-7bfe-4260-b364-6f8db2799229 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:42.498948 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a30bc39f-7bfe-4260-b364-6f8db2799229 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.169748 Oct 13 04:22:42.499764 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 403/813] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:42 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:42.690806 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-0a370c4b-d5de-451f-aec2-5165fd1f22e0 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:42.691799 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-0a370c4b-d5de-451f-aec2-5165fd1f22e0 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:42.701938 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0a370c4b-d5de-451f-aec2-5165fd1f22e0 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:42.702676 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0a370c4b-d5de-451f-aec2-5165fd1f22e0 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:42.703921 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0a370c4b-d5de-451f-aec2-5165fd1f22e0 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:42.704616 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0a370c4b-d5de-451f-aec2-5165fd1f22e0 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:42.837470 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-0a370c4b-d5de-451f-aec2-5165fd1f22e0 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:42.845172 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-0a370c4b-d5de-451f-aec2-5165fd1f22e0 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.160569 Oct 13 04:22:42.845768 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 411/814] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:42 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:43.521679 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c3c52002-2872-4cbb-aa61-f0484ce20019 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:43.522812 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c3c52002-2872-4cbb-aa61-f0484ce20019 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:43.531202 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c3c52002-2872-4cbb-aa61-f0484ce20019 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:43.531202 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c3c52002-2872-4cbb-aa61-f0484ce20019 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:43.531442 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c3c52002-2872-4cbb-aa61-f0484ce20019 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:43.531734 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c3c52002-2872-4cbb-aa61-f0484ce20019 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:43.652456 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c3c52002-2872-4cbb-aa61-f0484ce20019 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:43.661708 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c3c52002-2872-4cbb-aa61-f0484ce20019 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:43.663195 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c3c52002-2872-4cbb-aa61-f0484ce20019 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:43.664347 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c3c52002-2872-4cbb-aa61-f0484ce20019 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.149044 Oct 13 04:22:43.664905 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 404/815] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:43 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:43.862426 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-55909087-1a2c-464f-add4-fb6e515c3718 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:43.863045 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-55909087-1a2c-464f-add4-fb6e515c3718 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:43.869052 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-55909087-1a2c-464f-add4-fb6e515c3718 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:43.869510 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-55909087-1a2c-464f-add4-fb6e515c3718 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:43.870293 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-55909087-1a2c-464f-add4-fb6e515c3718 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:43.870719 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-55909087-1a2c-464f-add4-fb6e515c3718 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:43.998264 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-55909087-1a2c-464f-add4-fb6e515c3718 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:44.006038 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-55909087-1a2c-464f-add4-fb6e515c3718 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1315 microversion: 2.1 time: 0.147640 Oct 13 04:22:44.006691 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 412/816] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:43 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:44.158068 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5c57f6ab-cd2f-4db1-aff3-cf79e9840027 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:44.158949 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-5c57f6ab-cd2f-4db1-aff3-cf79e9840027 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:44.165164 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5c57f6ab-cd2f-4db1-aff3-cf79e9840027 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:44.165601 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5c57f6ab-cd2f-4db1-aff3-cf79e9840027 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:44.166425 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5c57f6ab-cd2f-4db1-aff3-cf79e9840027 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:44.166880 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5c57f6ab-cd2f-4db1-aff3-cf79e9840027 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:44.191625 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-5c57f6ab-cd2f-4db1-aff3-cf79e9840027 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Going to try to terminate instance {{(pid=108259) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:22:44.274326 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-5c57f6ab-cd2f-4db1-aff3-cf79e9840027 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "DELETE /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 204 len: 0 microversion: 2.1 time: 0.119616 Oct 13 04:22:44.275432 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 405/817] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:22:44 2021] DELETE /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:22:44.283692 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c7cca704-d62c-42d5-b8db-07827918a1ac tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:44.284299 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c7cca704-d62c-42d5-b8db-07827918a1ac tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:44.290532 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c7cca704-d62c-42d5-b8db-07827918a1ac tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:44.290971 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c7cca704-d62c-42d5-b8db-07827918a1ac tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:44.291716 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c7cca704-d62c-42d5-b8db-07827918a1ac tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:44.292134 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c7cca704-d62c-42d5-b8db-07827918a1ac tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:44.414027 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-c7cca704-d62c-42d5-b8db-07827918a1ac tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:44.421306 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c7cca704-d62c-42d5-b8db-07827918a1ac tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1506 microversion: 2.1 time: 0.141777 Oct 13 04:22:44.421926 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 413/818] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:44 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1506 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:22:44.694449 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-93b3f0af-6ac2-423e-944e-dc87ddc2f861 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:44.695560 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-93b3f0af-6ac2-423e-944e-dc87ddc2f861 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:44.702623 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-93b3f0af-6ac2-423e-944e-dc87ddc2f861 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:44.703066 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-93b3f0af-6ac2-423e-944e-dc87ddc2f861 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:44.703825 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-93b3f0af-6ac2-423e-944e-dc87ddc2f861 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:44.704248 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-93b3f0af-6ac2-423e-944e-dc87ddc2f861 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:44.837120 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-93b3f0af-6ac2-423e-944e-dc87ddc2f861 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:44.846410 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-93b3f0af-6ac2-423e-944e-dc87ddc2f861 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:44.847850 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-93b3f0af-6ac2-423e-944e-dc87ddc2f861 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:44.848993 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-93b3f0af-6ac2-423e-944e-dc87ddc2f861 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.161500 Oct 13 04:22:44.849553 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 406/819] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:44 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:45.027361 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a6f252d6-28f9-4433-8409-901a62fd1253 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:45.028752 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a6f252d6-28f9-4433-8409-901a62fd1253 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:45.039698 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a6f252d6-28f9-4433-8409-901a62fd1253 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:45.040430 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a6f252d6-28f9-4433-8409-901a62fd1253 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:45.041702 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a6f252d6-28f9-4433-8409-901a62fd1253 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:45.042453 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a6f252d6-28f9-4433-8409-901a62fd1253 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:45.170663 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a6f252d6-28f9-4433-8409-901a62fd1253 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:45.178085 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a6f252d6-28f9-4433-8409-901a62fd1253 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1465 microversion: 2.1 time: 0.157211 Oct 13 04:22:45.178656 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 414/820] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:45 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1465 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:45.217044 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-55bd4989-f941-4219-a698-3f232fac8024 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:45.217536 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-55bd4989-f941-4219-a698-3f232fac8024 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:45.223485 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-55bd4989-f941-4219-a698-3f232fac8024 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:45.223921 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-55bd4989-f941-4219-a698-3f232fac8024 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:45.224670 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-55bd4989-f941-4219-a698-3f232fac8024 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:45.225089 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-55bd4989-f941-4219-a698-3f232fac8024 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:45.248662 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-55bd4989-f941-4219-a698-3f232fac8024 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Going to try to terminate instance {{(pid=108259) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:22:45.326909 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-55bd4989-f941-4219-a698-3f232fac8024 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 204 len: 0 microversion: 2.1 time: 0.112547 Oct 13 04:22:45.328067 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 407/821] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:22:45 2021] DELETE /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:22:45.336607 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a14958e5-48b6-489b-b988-068d16a6294e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:45.337319 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a14958e5-48b6-489b-b988-068d16a6294e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:45.343302 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a14958e5-48b6-489b-b988-068d16a6294e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:45.343749 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a14958e5-48b6-489b-b988-068d16a6294e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:45.344507 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a14958e5-48b6-489b-b988-068d16a6294e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:45.344936 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a14958e5-48b6-489b-b988-068d16a6294e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:45.439151 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-9107f4d4-182e-4c4d-8944-5f2ef40bb2f3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:45.440033 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-9107f4d4-182e-4c4d-8944-5f2ef40bb2f3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:45.446405 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9107f4d4-182e-4c4d-8944-5f2ef40bb2f3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:45.447071 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9107f4d4-182e-4c4d-8944-5f2ef40bb2f3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:45.447807 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9107f4d4-182e-4c4d-8944-5f2ef40bb2f3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:45.448301 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9107f4d4-182e-4c4d-8944-5f2ef40bb2f3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:45.465319 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a14958e5-48b6-489b-b988-068d16a6294e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:45.472701 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a14958e5-48b6-489b-b988-068d16a6294e tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1471 microversion: 2.1 time: 0.140028 Oct 13 04:22:45.473237 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 415/822] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:45 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1471 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:22:45.573404 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-9107f4d4-182e-4c4d-8944-5f2ef40bb2f3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:45.588554 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-9107f4d4-182e-4c4d-8944-5f2ef40bb2f3 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1506 microversion: 2.1 time: 0.153434 Oct 13 04:22:45.589292 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 408/823] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:45 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:45.868399 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f3c4fd0e-7f01-4022-a898-37c6bd1cd9f3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:45.868989 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f3c4fd0e-7f01-4022-a898-37c6bd1cd9f3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:45.875238 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f3c4fd0e-7f01-4022-a898-37c6bd1cd9f3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:45.875677 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f3c4fd0e-7f01-4022-a898-37c6bd1cd9f3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:45.876421 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f3c4fd0e-7f01-4022-a898-37c6bd1cd9f3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:45.876844 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f3c4fd0e-7f01-4022-a898-37c6bd1cd9f3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:46.008884 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f3c4fd0e-7f01-4022-a898-37c6bd1cd9f3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:46.018183 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f3c4fd0e-7f01-4022-a898-37c6bd1cd9f3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:46.019673 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f3c4fd0e-7f01-4022-a898-37c6bd1cd9f3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:46.020913 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f3c4fd0e-7f01-4022-a898-37c6bd1cd9f3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.156477 Oct 13 04:22:46.021465 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 416/824] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:45 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 04:22:46.494573 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d94e8da4-1b40-4a01-be43-5ad76a72f113 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:46.495154 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d94e8da4-1b40-4a01-be43-5ad76a72f113 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:46.501974 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d94e8da4-1b40-4a01-be43-5ad76a72f113 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:46.502421 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d94e8da4-1b40-4a01-be43-5ad76a72f113 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:46.503163 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d94e8da4-1b40-4a01-be43-5ad76a72f113 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:46.503604 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d94e8da4-1b40-4a01-be43-5ad76a72f113 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:46.605404 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7061602e-4693-4225-b385-a4c2daa3e8df tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:46.606001 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7061602e-4693-4225-b385-a4c2daa3e8df tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:46.612260 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7061602e-4693-4225-b385-a4c2daa3e8df tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:46.612676 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7061602e-4693-4225-b385-a4c2daa3e8df tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:46.613675 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7061602e-4693-4225-b385-a4c2daa3e8df tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:46.614133 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7061602e-4693-4225-b385-a4c2daa3e8df tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:46.630069 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-d94e8da4-1b40-4a01-be43-5ad76a72f113 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:46.637460 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d94e8da4-1b40-4a01-be43-5ad76a72f113 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1471 microversion: 2.1 time: 0.149096 Oct 13 04:22:46.638179 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 409/825] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:46 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:46.733449 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-7061602e-4693-4225-b385-a4c2daa3e8df tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:46.741466 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7061602e-4693-4225-b385-a4c2daa3e8df tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1506 microversion: 2.1 time: 0.139794 Oct 13 04:22:46.742090 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 417/826] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:46 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1506 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:47.046374 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2a0b95a5-2573-4772-b8ae-70b27479109d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:47.047008 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2a0b95a5-2573-4772-b8ae-70b27479109d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:47.053249 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2a0b95a5-2573-4772-b8ae-70b27479109d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:47.053733 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2a0b95a5-2573-4772-b8ae-70b27479109d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:47.054493 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2a0b95a5-2573-4772-b8ae-70b27479109d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:47.054917 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2a0b95a5-2573-4772-b8ae-70b27479109d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:47.191193 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2a0b95a5-2573-4772-b8ae-70b27479109d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:47.199489 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2a0b95a5-2573-4772-b8ae-70b27479109d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:47.201017 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2a0b95a5-2573-4772-b8ae-70b27479109d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:47.202208 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2a0b95a5-2573-4772-b8ae-70b27479109d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.159721 Oct 13 04:22:47.202778 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 410/827] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:47 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:47.655855 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-95516d6a-b6f7-46a6-af56-adaf4caaeb68 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:47.656667 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-95516d6a-b6f7-46a6-af56-adaf4caaeb68 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:47.663378 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-95516d6a-b6f7-46a6-af56-adaf4caaeb68 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:47.663908 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-95516d6a-b6f7-46a6-af56-adaf4caaeb68 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:47.664790 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-95516d6a-b6f7-46a6-af56-adaf4caaeb68 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:47.665321 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-95516d6a-b6f7-46a6-af56-adaf4caaeb68 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:47.764070 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-16961dd7-1372-40e1-af2c-f7d4e7760e02 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:47.764825 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-16961dd7-1372-40e1-af2c-f7d4e7760e02 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:47.772415 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-16961dd7-1372-40e1-af2c-f7d4e7760e02 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:47.772838 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-16961dd7-1372-40e1-af2c-f7d4e7760e02 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:47.773653 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-16961dd7-1372-40e1-af2c-f7d4e7760e02 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:47.774076 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-16961dd7-1372-40e1-af2c-f7d4e7760e02 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:47.958848 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-95516d6a-b6f7-46a6-af56-adaf4caaeb68 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:47.966238 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-95516d6a-b6f7-46a6-af56-adaf4caaeb68 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1471 microversion: 2.1 time: 0.314362 Oct 13 04:22:47.967018 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 418/828] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:47 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1471 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:47.981173 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-9b7a9867-f7e6-41ad-b87d-df57f9e73815 req-b67c65bf-cb0a-42f5-bbeb-5f8637152232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c2b8a8f-db02-4581-b497-1f4caa68240f", "name": "network-vif-plugged", "status": "completed", "tag": "819b5060-2257-431d-a719-93e3e23c273c"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:22:47.982795 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:22:47.982795 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:22:47.989893 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-9b7a9867-f7e6-41ad-b87d-df57f9e73815 req-b67c65bf-cb0a-42f5-bbeb-5f8637152232 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:47.990316 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-9b7a9867-f7e6-41ad-b87d-df57f9e73815 req-b67c65bf-cb0a-42f5-bbeb-5f8637152232 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:48.001220 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-9b7a9867-f7e6-41ad-b87d-df57f9e73815 req-b67c65bf-cb0a-42f5-bbeb-5f8637152232 service nova] Creating event network-vif-plugged:819b5060-2257-431d-a719-93e3e23c273c for instance 3c2b8a8f-db02-4581-b497-1f4caa68240f on hv-cinder-81275 Oct 13 04:22:48.006336 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-9b7a9867-f7e6-41ad-b87d-df57f9e73815 req-b67c65bf-cb0a-42f5-bbeb-5f8637152232 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028733 Oct 13 04:22:48.006954 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 419/829] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:22:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:22:48.106165 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-16961dd7-1372-40e1-af2c-f7d4e7760e02 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:48.114263 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-16961dd7-1372-40e1-af2c-f7d4e7760e02 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1506 microversion: 2.1 time: 0.355202 Oct 13 04:22:48.114821 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 411/830] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:47 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:22:48.220835 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9c67192c-c2f7-4e73-8546-5c156a64f5e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:48.221650 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9c67192c-c2f7-4e73-8546-5c156a64f5e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:48.228051 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9c67192c-c2f7-4e73-8546-5c156a64f5e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:48.228821 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9c67192c-c2f7-4e73-8546-5c156a64f5e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:48.229630 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9c67192c-c2f7-4e73-8546-5c156a64f5e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:48.230069 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9c67192c-c2f7-4e73-8546-5c156a64f5e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:48.264983 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-3a2e415b-7bb5-40c6-90aa-32b6563f078f req-e76c8c2f-b0eb-4cb2-b8e4-158566b03a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39ca441-9306-4e97-8dee-e2ae3367c0dc", "name": "network-vif-deleted", "tag": "6a971d86-b9a8-4230-9244-991803f191ba"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:22:48.267461 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:22:48.267461 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:22:48.275969 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-3a2e415b-7bb5-40c6-90aa-32b6563f078f req-e76c8c2f-b0eb-4cb2-b8e4-158566b03a3c service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:48.276661 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-3a2e415b-7bb5-40c6-90aa-32b6563f078f req-e76c8c2f-b0eb-4cb2-b8e4-158566b03a3c service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:48.292327 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-3a2e415b-7bb5-40c6-90aa-32b6563f078f req-e76c8c2f-b0eb-4cb2-b8e4-158566b03a3c service nova] Creating event network-vif-deleted:6a971d86-b9a8-4230-9244-991803f191ba for instance e39ca441-9306-4e97-8dee-e2ae3367c0dc on hv-cinder-81275 Oct 13 04:22:48.298259 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-3a2e415b-7bb5-40c6-90aa-32b6563f078f req-e76c8c2f-b0eb-4cb2-b8e4-158566b03a3c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037159 Oct 13 04:22:48.299600 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 412/831] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:22:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:22:48.467627 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-9c67192c-c2f7-4e73-8546-5c156a64f5e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:48.476687 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-9c67192c-c2f7-4e73-8546-5c156a64f5e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:48.478560 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-9c67192c-c2f7-4e73-8546-5c156a64f5e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:48.479712 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9c67192c-c2f7-4e73-8546-5c156a64f5e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.263065 Oct 13 04:22:48.480474 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 420/832] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:48 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:48.983898 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e315d8bf-968d-4f5b-ac0a-44445d1458b8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:48.984576 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e315d8bf-968d-4f5b-ac0a-44445d1458b8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:48.991042 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e315d8bf-968d-4f5b-ac0a-44445d1458b8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:48.991700 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e315d8bf-968d-4f5b-ac0a-44445d1458b8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:48.992503 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e315d8bf-968d-4f5b-ac0a-44445d1458b8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:48.992930 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e315d8bf-968d-4f5b-ac0a-44445d1458b8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:49.023375 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e315d8bf-968d-4f5b-ac0a-44445d1458b8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:49.023831 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e315d8bf-968d-4f5b-ac0a-44445d1458b8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:49.024258 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-e315d8bf-968d-4f5b-ac0a-44445d1458b8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lazy-loading 'fault' on Instance uuid e39ca441-9306-4e97-8dee-e2ae3367c0dc {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:22:49.066263 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-e315d8bf-968d-4f5b-ac0a-44445d1458b8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e254c10abf0d4818abe81e9a550720b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01a13a65c994bd083bbc582b1e9acf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:49.073959 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e315d8bf-968d-4f5b-ac0a-44445d1458b8 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 200 len: 1305 microversion: 2.1 time: 0.094160 Oct 13 04:22:49.074694 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 413/833] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:48 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:49.131324 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-39a52e6d-0a5f-431b-b327-a8ed8364bdd5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:49.131898 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-39a52e6d-0a5f-431b-b327-a8ed8364bdd5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:49.138085 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-39a52e6d-0a5f-431b-b327-a8ed8364bdd5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:49.138530 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-39a52e6d-0a5f-431b-b327-a8ed8364bdd5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:49.139273 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-39a52e6d-0a5f-431b-b327-a8ed8364bdd5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:49.139693 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-39a52e6d-0a5f-431b-b327-a8ed8364bdd5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:49.173986 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-39a52e6d-0a5f-431b-b327-a8ed8364bdd5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:49.174423 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-39a52e6d-0a5f-431b-b327-a8ed8364bdd5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:49.174862 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.objects.instance [None req-39a52e6d-0a5f-431b-b327-a8ed8364bdd5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lazy-loading 'fault' on Instance uuid cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 {{(pid=108260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:22:49.216574 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-39a52e6d-0a5f-431b-b327-a8ed8364bdd5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:49.223898 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-39a52e6d-0a5f-431b-b327-a8ed8364bdd5 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 200 len: 1311 microversion: 2.1 time: 0.096267 Oct 13 04:22:49.224460 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 421/834] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:49 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:49.500114 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f48208ea-bf99-4e3d-a0ef-e021a67c805e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:49.500690 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f48208ea-bf99-4e3d-a0ef-e021a67c805e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:49.507555 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f48208ea-bf99-4e3d-a0ef-e021a67c805e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:49.508042 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f48208ea-bf99-4e3d-a0ef-e021a67c805e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:49.508886 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f48208ea-bf99-4e3d-a0ef-e021a67c805e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:49.509356 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f48208ea-bf99-4e3d-a0ef-e021a67c805e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:49.640834 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f48208ea-bf99-4e3d-a0ef-e021a67c805e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:49.649573 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f48208ea-bf99-4e3d-a0ef-e021a67c805e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:49.651070 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f48208ea-bf99-4e3d-a0ef-e021a67c805e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:49.652301 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f48208ea-bf99-4e3d-a0ef-e021a67c805e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.156780 Oct 13 04:22:49.652858 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 414/835] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:49 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:50.091766 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7cc7b6a1-f77e-4c90-ac90-1463522dd019 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:50.092368 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7cc7b6a1-f77e-4c90-ac90-1463522dd019 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] [instance: e39ca441-9306-4e97-8dee-e2ae3367c0dc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:50.101175 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7cc7b6a1-f77e-4c90-ac90-1463522dd019 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:50.101649 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7cc7b6a1-f77e-4c90-ac90-1463522dd019 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:50.102416 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7cc7b6a1-f77e-4c90-ac90-1463522dd019 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:50.102877 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7cc7b6a1-f77e-4c90-ac90-1463522dd019 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:50.117746 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-7cc7b6a1-f77e-4c90-ac90-1463522dd019 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] HTTP exception thrown: Instance e39ca441-9306-4e97-8dee-e2ae3367c0dc could not be found. Oct 13 04:22:50.118376 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7cc7b6a1-f77e-4c90-ac90-1463522dd019 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] Returning 404 to user: Instance e39ca441-9306-4e97-8dee-e2ae3367c0dc could not be found. {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:22:50.119123 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7cc7b6a1-f77e-4c90-ac90-1463522dd019 tempest-VolumesNegativeTest-1721027184 tempest-VolumesNegativeTest-1721027184-project] 10.222.0.55 "GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc" status: 404 len: 111 microversion: 2.1 time: 0.031402 Oct 13 04:22:50.119973 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 422/836] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:50 2021] GET /compute/v2.1/servers/e39ca441-9306-4e97-8dee-e2ae3367c0dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:22:50.240706 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-40b191ec-7800-4c60-9863-04ed42d272a9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:50.241302 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-40b191ec-7800-4c60-9863-04ed42d272a9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: cb288c24-304a-4fc1-bcbc-42dbfdec3fe1] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:50.247692 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-40b191ec-7800-4c60-9863-04ed42d272a9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:50.248126 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-40b191ec-7800-4c60-9863-04ed42d272a9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:50.248886 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-40b191ec-7800-4c60-9863-04ed42d272a9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:50.249305 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-40b191ec-7800-4c60-9863-04ed42d272a9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:50.263195 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-40b191ec-7800-4c60-9863-04ed42d272a9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] HTTP exception thrown: Instance cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 could not be found. Oct 13 04:22:50.263768 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-40b191ec-7800-4c60-9863-04ed42d272a9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Returning 404 to user: Instance cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:22:50.264592 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-40b191ec-7800-4c60-9863-04ed42d272a9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1" status: 404 len: 111 microversion: 2.1 time: 0.027653 Oct 13 04:22:50.265145 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 415/837] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:50 2021] GET /compute/v2.1/servers/cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:22:50.273543 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-326cc05e-a7da-472e-92b6-6d5c9d8a5cd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:50.274584 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-326cc05e-a7da-472e-92b6-6d5c9d8a5cd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:50.282015 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-326cc05e-a7da-472e-92b6-6d5c9d8a5cd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:50.282456 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-326cc05e-a7da-472e-92b6-6d5c9d8a5cd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:50.283951 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-326cc05e-a7da-472e-92b6-6d5c9d8a5cd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:50.284354 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-326cc05e-a7da-472e-92b6-6d5c9d8a5cd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:50.314368 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-b57e8f4c-02b9-43ba-a323-1f7e5b05a50e req-ba1a24fd-9073-40b6-8bcd-7b7c93fddc88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb288c24-304a-4fc1-bcbc-42dbfdec3fe1", "name": "network-vif-deleted", "tag": "d06e81cd-60bd-4e5e-b109-0c41c2176eff"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:22:50.316244 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:22:50.316244 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:22:50.316728 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-326cc05e-a7da-472e-92b6-6d5c9d8a5cd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Going to try to terminate instance {{(pid=108260) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:22:50.324649 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-b57e8f4c-02b9-43ba-a323-1f7e5b05a50e req-ba1a24fd-9073-40b6-8bcd-7b7c93fddc88 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:50.325396 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-b57e8f4c-02b9-43ba-a323-1f7e5b05a50e req-ba1a24fd-9073-40b6-8bcd-7b7c93fddc88 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:50.336792 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-b57e8f4c-02b9-43ba-a323-1f7e5b05a50e req-ba1a24fd-9073-40b6-8bcd-7b7c93fddc88 service nova] Creating event network-vif-deleted:d06e81cd-60bd-4e5e-b109-0c41c2176eff for instance cb288c24-304a-4fc1-bcbc-42dbfdec3fe1 on hv-cinder-81275 Oct 13 04:22:50.342712 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-b57e8f4c-02b9-43ba-a323-1f7e5b05a50e req-ba1a24fd-9073-40b6-8bcd-7b7c93fddc88 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031897 Oct 13 04:22:50.343610 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 416/838] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:22:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:22:50.413129 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-326cc05e-a7da-472e-92b6-6d5c9d8a5cd9 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "DELETE /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 204 len: 0 microversion: 2.1 time: 0.143329 Oct 13 04:22:50.414060 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 423/839] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:22:50 2021] DELETE /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:22:50.427364 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2344f872-8794-46ed-9b3c-f53808dd8efe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:50.428108 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2344f872-8794-46ed-9b3c-f53808dd8efe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:50.434183 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2344f872-8794-46ed-9b3c-f53808dd8efe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:50.434629 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2344f872-8794-46ed-9b3c-f53808dd8efe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:50.435387 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2344f872-8794-46ed-9b3c-f53808dd8efe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:50.435814 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2344f872-8794-46ed-9b3c-f53808dd8efe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:50.579774 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2344f872-8794-46ed-9b3c-f53808dd8efe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:50.588020 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2344f872-8794-46ed-9b3c-f53808dd8efe tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.167159 Oct 13 04:22:50.588581 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 417/840] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:50 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:22:50.670564 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-acaec7a7-d669-4794-81a8-b6ac8ecf8c91 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:50.671264 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-acaec7a7-d669-4794-81a8-b6ac8ecf8c91 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:50.677246 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-acaec7a7-d669-4794-81a8-b6ac8ecf8c91 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:50.677712 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-acaec7a7-d669-4794-81a8-b6ac8ecf8c91 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:50.678483 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-acaec7a7-d669-4794-81a8-b6ac8ecf8c91 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:50.678886 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-acaec7a7-d669-4794-81a8-b6ac8ecf8c91 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:50.804876 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-acaec7a7-d669-4794-81a8-b6ac8ecf8c91 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:50.813572 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-acaec7a7-d669-4794-81a8-b6ac8ecf8c91 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:50.815039 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-acaec7a7-d669-4794-81a8-b6ac8ecf8c91 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:50.817283 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-acaec7a7-d669-4794-81a8-b6ac8ecf8c91 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1806 microversion: 2.20 time: 0.150780 Oct 13 04:22:50.817874 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 424/841] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:50 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:51.604412 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-244d99dc-2b4f-4d28-a899-a4bbca05dec2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:51.605106 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-244d99dc-2b4f-4d28-a899-a4bbca05dec2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:51.611292 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-244d99dc-2b4f-4d28-a899-a4bbca05dec2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:51.611789 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-244d99dc-2b4f-4d28-a899-a4bbca05dec2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:51.612557 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-244d99dc-2b4f-4d28-a899-a4bbca05dec2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:51.612982 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-244d99dc-2b4f-4d28-a899-a4bbca05dec2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:51.753427 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-244d99dc-2b4f-4d28-a899-a4bbca05dec2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:51.760804 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-244d99dc-2b4f-4d28-a899-a4bbca05dec2 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.160366 Oct 13 04:22:51.761349 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 418/842] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:51 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:51.835364 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-84cefd98-8ca8-41f1-bd06-af577240e33d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:51.835964 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-84cefd98-8ca8-41f1-bd06-af577240e33d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:51.841818 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84cefd98-8ca8-41f1-bd06-af577240e33d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:51.842258 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84cefd98-8ca8-41f1-bd06-af577240e33d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:51.843016 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84cefd98-8ca8-41f1-bd06-af577240e33d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:51.843441 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84cefd98-8ca8-41f1-bd06-af577240e33d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:51.964302 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-84cefd98-8ca8-41f1-bd06-af577240e33d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:51.972633 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-84cefd98-8ca8-41f1-bd06-af577240e33d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:51.974262 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-84cefd98-8ca8-41f1-bd06-af577240e33d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:51.975415 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-84cefd98-8ca8-41f1-bd06-af577240e33d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1793 microversion: 2.20 time: 0.143716 Oct 13 04:22:51.975963 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 425/843] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:22:51 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1793 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:22:52.781198 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-6307c365-68e4-4872-9306-a9909074b381 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:52.782217 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-6307c365-68e4-4872-9306-a9909074b381 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:52.792220 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6307c365-68e4-4872-9306-a9909074b381 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:52.792961 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6307c365-68e4-4872-9306-a9909074b381 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:52.794266 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6307c365-68e4-4872-9306-a9909074b381 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:52.795080 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6307c365-68e4-4872-9306-a9909074b381 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:52.922674 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-6307c365-68e4-4872-9306-a9909074b381 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:52.934523 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-6307c365-68e4-4872-9306-a9909074b381 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.159191 Oct 13 04:22:52.935393 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 419/844] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:52 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:53.957050 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a356ad31-7d0f-4986-8465-2382d138b543 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:53.957719 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a356ad31-7d0f-4986-8465-2382d138b543 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:53.966019 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a356ad31-7d0f-4986-8465-2382d138b543 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:53.966651 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a356ad31-7d0f-4986-8465-2382d138b543 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:53.967721 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a356ad31-7d0f-4986-8465-2382d138b543 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:53.968153 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a356ad31-7d0f-4986-8465-2382d138b543 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:54.097042 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a356ad31-7d0f-4986-8465-2382d138b543 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:54.105248 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a356ad31-7d0f-4986-8465-2382d138b543 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.152194 Oct 13 04:22:54.105924 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 426/845] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:53 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:55.122739 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a28215a6-c29c-4889-81a3-bb298179a200 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:55.123339 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a28215a6-c29c-4889-81a3-bb298179a200 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:55.129422 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a28215a6-c29c-4889-81a3-bb298179a200 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:55.129896 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a28215a6-c29c-4889-81a3-bb298179a200 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:55.130658 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a28215a6-c29c-4889-81a3-bb298179a200 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:55.131090 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a28215a6-c29c-4889-81a3-bb298179a200 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:55.257143 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a28215a6-c29c-4889-81a3-bb298179a200 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:55.264596 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a28215a6-c29c-4889-81a3-bb298179a200 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.145564 Oct 13 04:22:55.265158 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 420/846] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:55 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:56.281376 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-17271127-b132-4f05-b559-739ae8d1b0da tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:56.282003 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-17271127-b132-4f05-b559-739ae8d1b0da tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:56.288074 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-17271127-b132-4f05-b559-739ae8d1b0da tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:56.288509 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-17271127-b132-4f05-b559-739ae8d1b0da tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:56.289258 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-17271127-b132-4f05-b559-739ae8d1b0da tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:56.289698 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-17271127-b132-4f05-b559-739ae8d1b0da tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:56.488216 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-17271127-b132-4f05-b559-739ae8d1b0da tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98410f486ef48e396526c6528d7d1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40f7ce511c4c95acdbf891d32505c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:22:56.496683 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-17271127-b132-4f05-b559-739ae8d1b0da tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 200 len: 1520 microversion: 2.1 time: 0.218451 Oct 13 04:22:56.507425 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 427/847] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:56 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:22:56.753776 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-5f6758da-0579-45cc-b578-9e1acce693aa req-38fbeb05-8635-4ad2-bff4-c11e65042702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b4223c8-bfe1-440e-89bc-7158a1490e1c", "name": "network-vif-deleted", "tag": "a005bba9-2263-44ad-abba-36d29b7c7e7c"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:22:56.755325 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:22:56.755325 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:22:56.762656 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-5f6758da-0579-45cc-b578-9e1acce693aa req-38fbeb05-8635-4ad2-bff4-c11e65042702 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:56.763092 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-5f6758da-0579-45cc-b578-9e1acce693aa req-38fbeb05-8635-4ad2-bff4-c11e65042702 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:56.773645 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-5f6758da-0579-45cc-b578-9e1acce693aa req-38fbeb05-8635-4ad2-bff4-c11e65042702 service nova] Creating event network-vif-deleted:a005bba9-2263-44ad-abba-36d29b7c7e7c for instance 2b4223c8-bfe1-440e-89bc-7158a1490e1c on hv-cinder-81275 Oct 13 04:22:56.778728 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-5f6758da-0579-45cc-b578-9e1acce693aa req-38fbeb05-8635-4ad2-bff4-c11e65042702 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208816 Oct 13 04:22:56.779374 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 421/848] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:22:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:22:57.518112 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1b8de5c7-4da4-48a1-b018-bff1a8c672f8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:22:57.519117 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-1b8de5c7-4da4-48a1-b018-bff1a8c672f8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] [instance: 2b4223c8-bfe1-440e-89bc-7158a1490e1c] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:22:57.529454 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1b8de5c7-4da4-48a1-b018-bff1a8c672f8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:57.530238 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1b8de5c7-4da4-48a1-b018-bff1a8c672f8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:57.531593 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1b8de5c7-4da4-48a1-b018-bff1a8c672f8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:22:57.532046 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1b8de5c7-4da4-48a1-b018-bff1a8c672f8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:22:57.545856 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-1b8de5c7-4da4-48a1-b018-bff1a8c672f8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] HTTP exception thrown: Instance 2b4223c8-bfe1-440e-89bc-7158a1490e1c could not be found. Oct 13 04:22:57.546431 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1b8de5c7-4da4-48a1-b018-bff1a8c672f8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] Returning 404 to user: Instance 2b4223c8-bfe1-440e-89bc-7158a1490e1c could not be found. {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:22:57.547294 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-1b8de5c7-4da4-48a1-b018-bff1a8c672f8 tempest-ServerRescueNegativeTestJSON-2067938041 tempest-ServerRescueNegativeTestJSON-2067938041-project] 10.222.0.55 "GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c" status: 404 len: 111 microversion: 2.1 time: 0.035278 Oct 13 04:22:57.547758 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 428/849] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:22:57 2021] GET /compute/v2.1/servers/2b4223c8-bfe1-440e-89bc-7158a1490e1c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:23:13.493337 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a8b54bef-8110-4755-95a2-20c3fb1207bd tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:23:13.494691 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a8b54bef-8110-4755-95a2-20c3fb1207bd tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:13.503164 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a8b54bef-8110-4755-95a2-20c3fb1207bd tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:13.503746 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a8b54bef-8110-4755-95a2-20c3fb1207bd tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:13.504733 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a8b54bef-8110-4755-95a2-20c3fb1207bd tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:13.505305 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a8b54bef-8110-4755-95a2-20c3fb1207bd tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:13.582980 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a8b54bef-8110-4755-95a2-20c3fb1207bd tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "POST /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/action" status: 202 len: 0 microversion: 2.1 time: 0.095708 Oct 13 04:23:13.583923 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 422/850] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:23:13 2021] POST /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:23:13.598031 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b75fdaad-ff8e-4451-b09a-b1d8f7374b90 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:13.598550 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b75fdaad-ff8e-4451-b09a-b1d8f7374b90 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:13.605316 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b75fdaad-ff8e-4451-b09a-b1d8f7374b90 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:13.605316 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b75fdaad-ff8e-4451-b09a-b1d8f7374b90 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:13.606035 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b75fdaad-ff8e-4451-b09a-b1d8f7374b90 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:13.606456 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b75fdaad-ff8e-4451-b09a-b1d8f7374b90 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:13.748966 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b75fdaad-ff8e-4451-b09a-b1d8f7374b90 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:13.758597 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b75fdaad-ff8e-4451-b09a-b1d8f7374b90 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1752 microversion: 2.1 time: 0.170491 Oct 13 04:23:13.759210 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 429/851] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:13 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:13.854988 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c66077c4-52e3-47b4-b8a3-da3da71473c8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:13.855703 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c66077c4-52e3-47b4-b8a3-da3da71473c8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:13.862007 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c66077c4-52e3-47b4-b8a3-da3da71473c8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:13.862688 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c66077c4-52e3-47b4-b8a3-da3da71473c8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:13.863667 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c66077c4-52e3-47b4-b8a3-da3da71473c8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:13.864290 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c66077c4-52e3-47b4-b8a3-da3da71473c8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:13.956422 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-c66077c4-52e3-47b4-b8a3-da3da71473c8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lazy-loading 'services' on Instance uuid 6a527ca0-f4d9-4478-8737-56edd7fe83fc {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:23:14.026504 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c66077c4-52e3-47b4-b8a3-da3da71473c8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/os-volume_attachments/0707ad48-f175-4f51-90c2-f89817740489" status: 202 len: 0 microversion: 2.1 time: 0.363608 Oct 13 04:23:14.027075 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 423/852] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Oct 13 04:23:13 2021] DELETE /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/os-volume_attachments/0707ad48-f175-4f51-90c2-f89817740489 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:23:14.776687 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3a5c0b6e-1512-4037-ac68-4ed5fdbe6999 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:14.777308 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3a5c0b6e-1512-4037-ac68-4ed5fdbe6999 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:14.783706 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3a5c0b6e-1512-4037-ac68-4ed5fdbe6999 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:14.784136 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3a5c0b6e-1512-4037-ac68-4ed5fdbe6999 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:14.784930 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3a5c0b6e-1512-4037-ac68-4ed5fdbe6999 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:14.785345 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3a5c0b6e-1512-4037-ac68-4ed5fdbe6999 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:14.915757 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-3a5c0b6e-1512-4037-ac68-4ed5fdbe6999 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:14.927294 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3a5c0b6e-1512-4037-ac68-4ed5fdbe6999 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1757 microversion: 2.1 time: 0.153802 Oct 13 04:23:14.927819 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 430/853] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:14 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1757 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:15.142228 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ae0552f9-cd63-4a90-a72d-1797489215ff tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:23:15.149237 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ae0552f9-cd63-4a90-a72d-1797489215ff tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:15.149787 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ae0552f9-cd63-4a90-a72d-1797489215ff tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:15.171589 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ae0552f9-cd63-4a90-a72d-1797489215ff tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Going to try to stop instance {{(pid=108259) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 13 04:23:15.215879 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ae0552f9-cd63-4a90-a72d-1797489215ff tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 202 len: 0 microversion: 2.1 time: 0.077383 Oct 13 04:23:15.216925 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 424/854] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:23:15 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:23:15.226558 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4a62d57d-6fa1-4a63-beae-60aaccffc399 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:15.227158 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4a62d57d-6fa1-4a63-beae-60aaccffc399 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:15.233264 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4a62d57d-6fa1-4a63-beae-60aaccffc399 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:15.233700 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4a62d57d-6fa1-4a63-beae-60aaccffc399 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:15.234705 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4a62d57d-6fa1-4a63-beae-60aaccffc399 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:15.235103 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4a62d57d-6fa1-4a63-beae-60aaccffc399 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:15.361293 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4a62d57d-6fa1-4a63-beae-60aaccffc399 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:15.368973 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4a62d57d-6fa1-4a63-beae-60aaccffc399 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1678 microversion: 2.1 time: 0.146262 Oct 13 04:23:15.369551 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 431/855] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:15 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:15.950038 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-bec5f79a-93db-47f5-95e6-6784ece81e7a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:15.951154 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-bec5f79a-93db-47f5-95e6-6784ece81e7a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:15.960528 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bec5f79a-93db-47f5-95e6-6784ece81e7a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:15.960964 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bec5f79a-93db-47f5-95e6-6784ece81e7a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:15.961758 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bec5f79a-93db-47f5-95e6-6784ece81e7a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:15.962179 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bec5f79a-93db-47f5-95e6-6784ece81e7a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:16.090553 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-bec5f79a-93db-47f5-95e6-6784ece81e7a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:16.098207 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-bec5f79a-93db-47f5-95e6-6784ece81e7a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1757 microversion: 2.1 time: 0.155075 Oct 13 04:23:16.098728 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 425/856] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:15 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1757 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:16.386245 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-dd4ce758-36b6-4c07-bbc3-4ff9bff9300b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:16.386947 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-dd4ce758-36b6-4c07-bbc3-4ff9bff9300b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:16.392931 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dd4ce758-36b6-4c07-bbc3-4ff9bff9300b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:16.393626 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dd4ce758-36b6-4c07-bbc3-4ff9bff9300b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:16.394392 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dd4ce758-36b6-4c07-bbc3-4ff9bff9300b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:16.394819 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-dd4ce758-36b6-4c07-bbc3-4ff9bff9300b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:16.521160 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-dd4ce758-36b6-4c07-bbc3-4ff9bff9300b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:16.528858 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-dd4ce758-36b6-4c07-bbc3-4ff9bff9300b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1678 microversion: 2.1 time: 0.146363 Oct 13 04:23:16.529423 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 432/857] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:16 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:17.119436 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-744e4fdb-59a3-4969-aca1-3cd3a6900c89 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:17.120564 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-744e4fdb-59a3-4969-aca1-3cd3a6900c89 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:17.130864 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-744e4fdb-59a3-4969-aca1-3cd3a6900c89 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:17.131297 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-744e4fdb-59a3-4969-aca1-3cd3a6900c89 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:17.132047 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-744e4fdb-59a3-4969-aca1-3cd3a6900c89 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:17.132469 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-744e4fdb-59a3-4969-aca1-3cd3a6900c89 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:17.255340 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-744e4fdb-59a3-4969-aca1-3cd3a6900c89 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:17.263067 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-744e4fdb-59a3-4969-aca1-3cd3a6900c89 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1757 microversion: 2.1 time: 0.149874 Oct 13 04:23:17.263636 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 426/858] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:17 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1757 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:17.546274 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a68ab562-59cc-4dd0-b393-7360d5157f6c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:17.546879 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a68ab562-59cc-4dd0-b393-7360d5157f6c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:17.553119 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a68ab562-59cc-4dd0-b393-7360d5157f6c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:17.553635 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a68ab562-59cc-4dd0-b393-7360d5157f6c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:17.554382 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a68ab562-59cc-4dd0-b393-7360d5157f6c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:17.554805 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a68ab562-59cc-4dd0-b393-7360d5157f6c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:17.680373 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a68ab562-59cc-4dd0-b393-7360d5157f6c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:17.687939 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a68ab562-59cc-4dd0-b393-7360d5157f6c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1678 microversion: 2.1 time: 0.145263 Oct 13 04:23:17.688512 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 433/859] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:17 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:18.284610 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c52372ba-9a74-46d5-8962-277d70986a33 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:18.285646 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c52372ba-9a74-46d5-8962-277d70986a33 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:18.292497 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c52372ba-9a74-46d5-8962-277d70986a33 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:18.292949 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c52372ba-9a74-46d5-8962-277d70986a33 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:18.293726 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c52372ba-9a74-46d5-8962-277d70986a33 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:18.294163 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c52372ba-9a74-46d5-8962-277d70986a33 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:18.428885 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c52372ba-9a74-46d5-8962-277d70986a33 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:18.439021 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c52372ba-9a74-46d5-8962-277d70986a33 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1757 microversion: 2.1 time: 0.160737 Oct 13 04:23:18.439598 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 427/860] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:18 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:18.708469 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-91d58985-061e-46a8-83f3-1858dc138b25 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:18.709060 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-91d58985-061e-46a8-83f3-1858dc138b25 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:18.716209 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-91d58985-061e-46a8-83f3-1858dc138b25 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:18.716669 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-91d58985-061e-46a8-83f3-1858dc138b25 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:18.717457 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-91d58985-061e-46a8-83f3-1858dc138b25 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:18.717931 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-91d58985-061e-46a8-83f3-1858dc138b25 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:18.847280 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-91d58985-061e-46a8-83f3-1858dc138b25 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:18.855757 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-91d58985-061e-46a8-83f3-1858dc138b25 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1678 microversion: 2.1 time: 0.153337 Oct 13 04:23:18.856394 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 434/861] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:18 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:19.458114 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c8c40028-2881-414a-abfb-dad89aac925a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:19.458781 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c8c40028-2881-414a-abfb-dad89aac925a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:19.464596 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c8c40028-2881-414a-abfb-dad89aac925a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:19.465035 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c8c40028-2881-414a-abfb-dad89aac925a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:19.465863 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c8c40028-2881-414a-abfb-dad89aac925a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:19.466286 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c8c40028-2881-414a-abfb-dad89aac925a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:19.595234 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c8c40028-2881-414a-abfb-dad89aac925a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:19.603176 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c8c40028-2881-414a-abfb-dad89aac925a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1757 microversion: 2.1 time: 0.149080 Oct 13 04:23:19.603735 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 428/862] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:19 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1757 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:19.876931 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a22a5f93-c90d-4ead-bfa9-0b62983ac141 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:19.877838 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a22a5f93-c90d-4ead-bfa9-0b62983ac141 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:19.885125 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a22a5f93-c90d-4ead-bfa9-0b62983ac141 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:19.885569 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a22a5f93-c90d-4ead-bfa9-0b62983ac141 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:19.886368 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a22a5f93-c90d-4ead-bfa9-0b62983ac141 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:19.886804 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a22a5f93-c90d-4ead-bfa9-0b62983ac141 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:20.020978 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a22a5f93-c90d-4ead-bfa9-0b62983ac141 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:20.028789 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a22a5f93-c90d-4ead-bfa9-0b62983ac141 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1678 microversion: 2.1 time: 0.158189 Oct 13 04:23:20.029311 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 435/863] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:19 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:20.620279 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0b057bcb-1e40-4e7b-9d64-4064490dcff3 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:20.620889 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0b057bcb-1e40-4e7b-9d64-4064490dcff3 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:20.627193 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0b057bcb-1e40-4e7b-9d64-4064490dcff3 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:20.627720 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0b057bcb-1e40-4e7b-9d64-4064490dcff3 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:20.628491 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0b057bcb-1e40-4e7b-9d64-4064490dcff3 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:20.628920 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0b057bcb-1e40-4e7b-9d64-4064490dcff3 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:20.754596 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-0b057bcb-1e40-4e7b-9d64-4064490dcff3 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:20.762701 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0b057bcb-1e40-4e7b-9d64-4064490dcff3 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1757 microversion: 2.1 time: 0.146164 Oct 13 04:23:20.763309 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 429/864] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:20 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1757 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:21.046781 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4b6de165-1087-42ae-bf1c-8b424403d5a0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:21.047387 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4b6de165-1087-42ae-bf1c-8b424403d5a0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:21.053723 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4b6de165-1087-42ae-bf1c-8b424403d5a0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:21.054173 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4b6de165-1087-42ae-bf1c-8b424403d5a0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:21.054946 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4b6de165-1087-42ae-bf1c-8b424403d5a0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:21.055373 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4b6de165-1087-42ae-bf1c-8b424403d5a0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:21.184792 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4b6de165-1087-42ae-bf1c-8b424403d5a0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:21.192005 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4b6de165-1087-42ae-bf1c-8b424403d5a0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1678 microversion: 2.1 time: 0.148947 Oct 13 04:23:21.192547 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 436/865] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:21 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:21.780089 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e1521796-0cee-4ac6-a5d0-2fb7e6c258ec tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:21.780843 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e1521796-0cee-4ac6-a5d0-2fb7e6c258ec tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:21.788036 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e1521796-0cee-4ac6-a5d0-2fb7e6c258ec tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:21.788579 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e1521796-0cee-4ac6-a5d0-2fb7e6c258ec tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:21.789505 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e1521796-0cee-4ac6-a5d0-2fb7e6c258ec tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:21.790030 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e1521796-0cee-4ac6-a5d0-2fb7e6c258ec tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:21.922158 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-e1521796-0cee-4ac6-a5d0-2fb7e6c258ec tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:21.930384 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e1521796-0cee-4ac6-a5d0-2fb7e6c258ec tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1757 microversion: 2.1 time: 0.154042 Oct 13 04:23:21.930934 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 430/866] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:21 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1757 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:22.207912 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7b64d712-4796-4708-bbeb-34f2e3a67329 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:22.208538 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7b64d712-4796-4708-bbeb-34f2e3a67329 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:22.214409 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7b64d712-4796-4708-bbeb-34f2e3a67329 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:22.214850 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7b64d712-4796-4708-bbeb-34f2e3a67329 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:22.215598 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7b64d712-4796-4708-bbeb-34f2e3a67329 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:22.216027 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7b64d712-4796-4708-bbeb-34f2e3a67329 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:22.334597 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-7b64d712-4796-4708-bbeb-34f2e3a67329 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:22.341947 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7b64d712-4796-4708-bbeb-34f2e3a67329 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1678 microversion: 2.1 time: 0.137689 Oct 13 04:23:22.342518 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 437/867] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:22 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1678 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:22.947730 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1a563e95-f66f-444d-b704-4e98e39f7b6c tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:22.948387 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1a563e95-f66f-444d-b704-4e98e39f7b6c tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:22.954731 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1a563e95-f66f-444d-b704-4e98e39f7b6c tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:22.955207 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1a563e95-f66f-444d-b704-4e98e39f7b6c tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:22.955956 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1a563e95-f66f-444d-b704-4e98e39f7b6c tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:22.956381 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1a563e95-f66f-444d-b704-4e98e39f7b6c tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:23.086042 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1a563e95-f66f-444d-b704-4e98e39f7b6c tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:23.094787 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1a563e95-f66f-444d-b704-4e98e39f7b6c tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1757 microversion: 2.1 time: 0.151000 Oct 13 04:23:23.095720 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 431/868] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:22 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1757 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:23.363137 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-27d90fee-6a03-4140-a16a-cc0f96354c04 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:23.364050 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-27d90fee-6a03-4140-a16a-cc0f96354c04 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:23.370529 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-27d90fee-6a03-4140-a16a-cc0f96354c04 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:23.371100 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-27d90fee-6a03-4140-a16a-cc0f96354c04 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:23.371874 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-27d90fee-6a03-4140-a16a-cc0f96354c04 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:23.372302 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-27d90fee-6a03-4140-a16a-cc0f96354c04 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:23.511589 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-27d90fee-6a03-4140-a16a-cc0f96354c04 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:23.519757 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-27d90fee-6a03-4140-a16a-cc0f96354c04 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1678 microversion: 2.1 time: 0.162839 Oct 13 04:23:23.520321 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 438/869] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:23 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:24.115680 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-33077cee-014f-4829-9bd0-e801bed15df2 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:24.116283 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-33077cee-014f-4829-9bd0-e801bed15df2 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:24.122970 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-33077cee-014f-4829-9bd0-e801bed15df2 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:24.123431 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-33077cee-014f-4829-9bd0-e801bed15df2 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:24.124221 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-33077cee-014f-4829-9bd0-e801bed15df2 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:24.124665 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-33077cee-014f-4829-9bd0-e801bed15df2 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:24.260187 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-33077cee-014f-4829-9bd0-e801bed15df2 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:24.267496 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-33077cee-014f-4829-9bd0-e801bed15df2 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1757 microversion: 2.1 time: 0.157534 Oct 13 04:23:24.268050 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 432/870] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:24 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:24.536849 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-816d9458-53e4-48bd-96f6-b0be99a878d0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:24.537430 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-816d9458-53e4-48bd-96f6-b0be99a878d0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:24.543694 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-816d9458-53e4-48bd-96f6-b0be99a878d0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:24.544143 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-816d9458-53e4-48bd-96f6-b0be99a878d0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:24.544910 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-816d9458-53e4-48bd-96f6-b0be99a878d0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:24.545335 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-816d9458-53e4-48bd-96f6-b0be99a878d0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:24.668612 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-816d9458-53e4-48bd-96f6-b0be99a878d0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:24.676561 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-816d9458-53e4-48bd-96f6-b0be99a878d0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1678 microversion: 2.1 time: 0.143989 Oct 13 04:23:24.677130 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 439/871] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:24 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1678 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:25.287131 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c27e60ff-9f04-45db-a3d5-38485d1ab8e8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:25.287860 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c27e60ff-9f04-45db-a3d5-38485d1ab8e8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:25.296148 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c27e60ff-9f04-45db-a3d5-38485d1ab8e8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:25.296743 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c27e60ff-9f04-45db-a3d5-38485d1ab8e8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:25.297764 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c27e60ff-9f04-45db-a3d5-38485d1ab8e8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:25.298372 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c27e60ff-9f04-45db-a3d5-38485d1ab8e8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:25.431052 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c27e60ff-9f04-45db-a3d5-38485d1ab8e8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:25.439642 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c27e60ff-9f04-45db-a3d5-38485d1ab8e8 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1757 microversion: 2.1 time: 0.157931 Oct 13 04:23:25.440238 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 433/872] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:25 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:25.693382 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f31a864f-a76f-445c-8e31-91f5a59e2169 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:25.694022 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f31a864f-a76f-445c-8e31-91f5a59e2169 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:25.700239 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f31a864f-a76f-445c-8e31-91f5a59e2169 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:25.700674 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f31a864f-a76f-445c-8e31-91f5a59e2169 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:25.701430 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f31a864f-a76f-445c-8e31-91f5a59e2169 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:25.701879 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f31a864f-a76f-445c-8e31-91f5a59e2169 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:25.827357 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f31a864f-a76f-445c-8e31-91f5a59e2169 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:25.834693 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f31a864f-a76f-445c-8e31-91f5a59e2169 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1655 microversion: 2.1 time: 0.144998 Oct 13 04:23:25.835253 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 440/873] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:25 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1655 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:25.851036 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a2c02da7-7ed0-420b-a209-417085e74522 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:23:25.856912 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a2c02da7-7ed0-420b-a209-417085e74522 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:25.857353 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a2c02da7-7ed0-420b-a209-417085e74522 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:25.880935 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a2c02da7-7ed0-420b-a209-417085e74522 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Going to try to start instance {{(pid=108259) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 13 04:23:25.922096 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a2c02da7-7ed0-420b-a209-417085e74522 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action" status: 202 len: 0 microversion: 2.1 time: 0.074875 Oct 13 04:23:25.922708 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 434/874] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:23:25 2021] POST /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:23:25.934939 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-58aca7c9-b501-458e-95dd-528edf616a08 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:25.935618 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-58aca7c9-b501-458e-95dd-528edf616a08 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:25.942585 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-58aca7c9-b501-458e-95dd-528edf616a08 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:25.943322 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-58aca7c9-b501-458e-95dd-528edf616a08 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:25.944633 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-58aca7c9-b501-458e-95dd-528edf616a08 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:25.945055 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-58aca7c9-b501-458e-95dd-528edf616a08 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:26.145065 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-58aca7c9-b501-458e-95dd-528edf616a08 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:26.153041 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-58aca7c9-b501-458e-95dd-528edf616a08 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1664 microversion: 2.1 time: 0.224243 Oct 13 04:23:26.154103 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 441/875] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:25 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1664 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:26.457804 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-52ad8264-409b-4fde-b4cf-9d1867c52032 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:26.458680 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-52ad8264-409b-4fde-b4cf-9d1867c52032 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:26.464997 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-52ad8264-409b-4fde-b4cf-9d1867c52032 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:26.465533 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-52ad8264-409b-4fde-b4cf-9d1867c52032 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:26.466425 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-52ad8264-409b-4fde-b4cf-9d1867c52032 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:26.466915 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-52ad8264-409b-4fde-b4cf-9d1867c52032 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:26.654482 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-52ad8264-409b-4fde-b4cf-9d1867c52032 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:26.663171 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-52ad8264-409b-4fde-b4cf-9d1867c52032 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1760 microversion: 2.1 time: 0.209682 Oct 13 04:23:26.677820 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 435/876] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:26 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1760 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:27.173555 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-77c77d63-03f2-41ef-b0c2-0d7c6cfdd31f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:27.174238 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-77c77d63-03f2-41ef-b0c2-0d7c6cfdd31f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:27.180817 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-77c77d63-03f2-41ef-b0c2-0d7c6cfdd31f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:27.181258 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-77c77d63-03f2-41ef-b0c2-0d7c6cfdd31f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:27.182097 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-77c77d63-03f2-41ef-b0c2-0d7c6cfdd31f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:27.182458 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-77c77d63-03f2-41ef-b0c2-0d7c6cfdd31f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:27.315501 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-77c77d63-03f2-41ef-b0c2-0d7c6cfdd31f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:27.323259 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-77c77d63-03f2-41ef-b0c2-0d7c6cfdd31f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1664 microversion: 2.1 time: 0.155349 Oct 13 04:23:27.323831 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 442/877] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:27 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:28.340341 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-fec99711-995f-438b-b932-e342b32359c4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:28.340909 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-fec99711-995f-438b-b932-e342b32359c4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:28.346838 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fec99711-995f-438b-b932-e342b32359c4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:28.347263 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fec99711-995f-438b-b932-e342b32359c4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:28.348054 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fec99711-995f-438b-b932-e342b32359c4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:28.348514 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fec99711-995f-438b-b932-e342b32359c4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:28.470583 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-fec99711-995f-438b-b932-e342b32359c4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:28.478159 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-fec99711-995f-438b-b932-e342b32359c4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1668 microversion: 2.1 time: 0.141840 Oct 13 04:23:28.478729 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 436/878] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:28 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1668 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:23:40.462570 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6548a780-1fcb-4fa5-8f05-2f6e43d351a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1943517570", "imageRef": "4f468f34-171a-4b6e-a0cd-2e4c6fcda23d", "flavorRef": "452", "networks": [{"uuid": "a8bb1f41-1bb3-4e4f-857c-6817089c3add"}]}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:23:40.517660 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.network.neutron [None req-6548a780-1fcb-4fa5-8f05-2f6e43d351a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] validate_networks() for [('a8bb1f41-1bb3-4e4f-857c-6817089c3add', None, None, None, None, None)] {{(pid=108260) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:23:40.939026 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-6548a780-1fcb-4fa5-8f05-2f6e43d351a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Flavor limits 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:23:40.939440 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-6548a780-1fcb-4fa5-8f05-2f6e43d351a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Image limits 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:23:40.939939 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-6548a780-1fcb-4fa5-8f05-2f6e43d351a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Flavor pref 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:23:40.940336 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-6548a780-1fcb-4fa5-8f05-2f6e43d351a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Image pref 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:23:40.940733 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-6548a780-1fcb-4fa5-8f05-2f6e43d351a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:23:40.950907 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6548a780-1fcb-4fa5-8f05-2f6e43d351a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:40.951347 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6548a780-1fcb-4fa5-8f05-2f6e43d351a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:40.952132 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6548a780-1fcb-4fa5-8f05-2f6e43d351a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:40.952872 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6548a780-1fcb-4fa5-8f05-2f6e43d351a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:40.970728 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-6548a780-1fcb-4fa5-8f05-2f6e43d351a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Getting quotas for project ad9e3664217546579b7f55d3081e6eb0. Resources: {'ram', 'cores', 'instances'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:23:40.975335 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-6548a780-1fcb-4fa5-8f05-2f6e43d351a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Getting quotas for user 893b2d39d23f49688d9535132468af8f and project ad9e3664217546579b7f55d3081e6eb0. Resources: {'ram', 'cores', 'instances'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:23:40.987634 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6548a780-1fcb-4fa5-8f05-2f6e43d351a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Going to run 1 instances... {{(pid=108260) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:23:40.989979 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6548a780-1fcb-4fa5-8f05-2f6e43d351a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f468f34-171a-4b6e-a0cd-2e4c6fcda23d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:23:41.037439 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6548a780-1fcb-4fa5-8f05-2f6e43d351a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578388 Oct 13 04:23:41.038105 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 443/879] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Oct 13 04:23:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 04:23:41.047917 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-eef3f714-715b-4728-a814-53d64f3d1897 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:41.048538 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-eef3f714-715b-4728-a814-53d64f3d1897 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:41.099923 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-eef3f714-715b-4728-a814-53d64f3d1897 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:41.106559 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-eef3f714-715b-4728-a814-53d64f3d1897 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8" status: 200 len: 1219 microversion: 2.1 time: 0.062437 Oct 13 04:23:41.107122 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 437/880] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:41 2021] GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8 => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:42.124048 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a6f32195-dbd0-45a5-9a19-4775a267573b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:42.124717 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a6f32195-dbd0-45a5-9a19-4775a267573b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:42.130652 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a6f32195-dbd0-45a5-9a19-4775a267573b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:42.131089 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a6f32195-dbd0-45a5-9a19-4775a267573b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:42.132211 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a6f32195-dbd0-45a5-9a19-4775a267573b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:42.132636 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a6f32195-dbd0-45a5-9a19-4775a267573b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:42.209627 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a6f32195-dbd0-45a5-9a19-4775a267573b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:42.219819 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a6f32195-dbd0-45a5-9a19-4775a267573b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8" status: 200 len: 1279 microversion: 2.1 time: 0.099647 Oct 13 04:23:42.220565 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 444/881] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:42 2021] GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8 => generated 1279 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:43.243262 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5ab56c98-0b2c-4669-95b0-fd18c68edcaa tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:43.244238 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-5ab56c98-0b2c-4669-95b0-fd18c68edcaa tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:43.251985 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5ab56c98-0b2c-4669-95b0-fd18c68edcaa tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:43.252657 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5ab56c98-0b2c-4669-95b0-fd18c68edcaa tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:43.253654 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5ab56c98-0b2c-4669-95b0-fd18c68edcaa tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:43.254080 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5ab56c98-0b2c-4669-95b0-fd18c68edcaa tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:43.449405 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-6d79ee98-f553-4f37-b220-5305906e9616 req-cf834c0d-df10-44fe-b1d0-6aef4ab8222b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9173ac96-e73d-4283-ba7a-11545df2d4f8", "tag": "4df24fd3-b933-4fc4-a6b1-8dc465f59508"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:23:43.451336 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:23:43.451336 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:23:43.459175 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-6d79ee98-f553-4f37-b220-5305906e9616 req-cf834c0d-df10-44fe-b1d0-6aef4ab8222b service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:43.459610 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-6d79ee98-f553-4f37-b220-5305906e9616 req-cf834c0d-df10-44fe-b1d0-6aef4ab8222b service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:43.478086 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-5ab56c98-0b2c-4669-95b0-fd18c68edcaa tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:43.480634 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-6d79ee98-f553-4f37-b220-5305906e9616 req-cf834c0d-df10-44fe-b1d0-6aef4ab8222b service nova] Creating event network-changed:4df24fd3-b933-4fc4-a6b1-8dc465f59508 for instance 9173ac96-e73d-4283-ba7a-11545df2d4f8 on hv-cinder-81275 Oct 13 04:23:43.485335 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-5ab56c98-0b2c-4669-95b0-fd18c68edcaa tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8" status: 200 len: 1319 microversion: 2.1 time: 0.248488 Oct 13 04:23:43.485586 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-6d79ee98-f553-4f37-b220-5305906e9616 req-cf834c0d-df10-44fe-b1d0-6aef4ab8222b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040716 Oct 13 04:23:43.486141 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 438/882] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:43 2021] GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:43.486489 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 445/883] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:23:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:23:44.505498 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-877b7854-ae6a-484a-9d1f-0460b1435800 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:44.506084 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-877b7854-ae6a-484a-9d1f-0460b1435800 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:44.512533 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-877b7854-ae6a-484a-9d1f-0460b1435800 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:44.512968 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-877b7854-ae6a-484a-9d1f-0460b1435800 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:44.513762 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-877b7854-ae6a-484a-9d1f-0460b1435800 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:44.514187 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-877b7854-ae6a-484a-9d1f-0460b1435800 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:44.636120 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-877b7854-ae6a-484a-9d1f-0460b1435800 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:44.643652 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-877b7854-ae6a-484a-9d1f-0460b1435800 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8" status: 200 len: 1319 microversion: 2.1 time: 0.144303 Oct 13 04:23:44.644224 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 439/884] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:44 2021] GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:45.665288 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-df10d27e-3934-4c49-af4d-355e488e5d66 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:45.666510 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-df10d27e-3934-4c49-af4d-355e488e5d66 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:45.676722 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-df10d27e-3934-4c49-af4d-355e488e5d66 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:45.677170 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-df10d27e-3934-4c49-af4d-355e488e5d66 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:45.677950 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-df10d27e-3934-4c49-af4d-355e488e5d66 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:45.678372 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-df10d27e-3934-4c49-af4d-355e488e5d66 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:45.811813 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-df10d27e-3934-4c49-af4d-355e488e5d66 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:45.823281 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-df10d27e-3934-4c49-af4d-355e488e5d66 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8" status: 200 len: 1319 microversion: 2.1 time: 0.164546 Oct 13 04:23:45.824138 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 446/885] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:45 2021] GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:46.847673 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1371f7f7-50a6-45b6-8d5c-11fd7f40261b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:46.848600 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1371f7f7-50a6-45b6-8d5c-11fd7f40261b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:46.856791 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1371f7f7-50a6-45b6-8d5c-11fd7f40261b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:46.857375 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1371f7f7-50a6-45b6-8d5c-11fd7f40261b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:46.858427 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1371f7f7-50a6-45b6-8d5c-11fd7f40261b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:46.858933 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1371f7f7-50a6-45b6-8d5c-11fd7f40261b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:47.001497 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1371f7f7-50a6-45b6-8d5c-11fd7f40261b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:47.009233 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1371f7f7-50a6-45b6-8d5c-11fd7f40261b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8" status: 200 len: 1319 microversion: 2.1 time: 0.167840 Oct 13 04:23:47.009823 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 440/886] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:46 2021] GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:48.031388 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-bfc63f5d-54fc-4c19-882c-f8c2b535e31b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:48.032516 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-bfc63f5d-54fc-4c19-882c-f8c2b535e31b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:48.038460 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bfc63f5d-54fc-4c19-882c-f8c2b535e31b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:48.039011 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bfc63f5d-54fc-4c19-882c-f8c2b535e31b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:48.039766 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bfc63f5d-54fc-4c19-882c-f8c2b535e31b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:48.040216 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bfc63f5d-54fc-4c19-882c-f8c2b535e31b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:48.168491 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-bfc63f5d-54fc-4c19-882c-f8c2b535e31b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:48.176140 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-bfc63f5d-54fc-4c19-882c-f8c2b535e31b tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8" status: 200 len: 1319 microversion: 2.1 time: 0.148399 Oct 13 04:23:48.176819 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 447/887] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:48 2021] GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:49.195593 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-926414b5-bf0a-4186-b91f-15ff78e60da2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:49.196439 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-926414b5-bf0a-4186-b91f-15ff78e60da2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:49.205436 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-926414b5-bf0a-4186-b91f-15ff78e60da2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:49.206119 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-926414b5-bf0a-4186-b91f-15ff78e60da2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:49.207202 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-926414b5-bf0a-4186-b91f-15ff78e60da2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:49.207810 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-926414b5-bf0a-4186-b91f-15ff78e60da2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:49.341984 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-926414b5-bf0a-4186-b91f-15ff78e60da2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:49.351360 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-926414b5-bf0a-4186-b91f-15ff78e60da2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8" status: 200 len: 1319 microversion: 2.1 time: 0.161173 Oct 13 04:23:49.351919 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 441/888] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:49 2021] GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:50.241120 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-6d06cf12-b37e-4765-a592-b04184b729b3 req-953ab2e9-2e1c-44ba-acf9-7848b7320315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9173ac96-e73d-4283-ba7a-11545df2d4f8", "name": "network-vif-plugged", "status": "completed", "tag": "4df24fd3-b933-4fc4-a6b1-8dc465f59508"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:23:50.242661 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:23:50.242661 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:23:50.249318 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-6d06cf12-b37e-4765-a592-b04184b729b3 req-953ab2e9-2e1c-44ba-acf9-7848b7320315 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:50.249795 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-6d06cf12-b37e-4765-a592-b04184b729b3 req-953ab2e9-2e1c-44ba-acf9-7848b7320315 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:50.260349 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-6d06cf12-b37e-4765-a592-b04184b729b3 req-953ab2e9-2e1c-44ba-acf9-7848b7320315 service nova] Creating event network-vif-plugged:4df24fd3-b933-4fc4-a6b1-8dc465f59508 for instance 9173ac96-e73d-4283-ba7a-11545df2d4f8 on hv-cinder-81275 Oct 13 04:23:50.265384 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-6d06cf12-b37e-4765-a592-b04184b729b3 req-953ab2e9-2e1c-44ba-acf9-7848b7320315 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151411 Oct 13 04:23:50.265949 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 448/889] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:23:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:23:50.368204 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-53203cd6-0c60-4b23-b4ee-e9e46e902433 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:50.369257 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-53203cd6-0c60-4b23-b4ee-e9e46e902433 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:50.376538 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-53203cd6-0c60-4b23-b4ee-e9e46e902433 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:50.376984 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-53203cd6-0c60-4b23-b4ee-e9e46e902433 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:50.378121 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-53203cd6-0c60-4b23-b4ee-e9e46e902433 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:50.378620 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-53203cd6-0c60-4b23-b4ee-e9e46e902433 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:50.551593 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-53203cd6-0c60-4b23-b4ee-e9e46e902433 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:50.559238 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-53203cd6-0c60-4b23-b4ee-e9e46e902433 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8" status: 200 len: 1319 microversion: 2.1 time: 0.195032 Oct 13 04:23:50.559878 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 442/890] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:50 2021] GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:51.577016 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6d77861f-f458-4983-8c2e-ff0518c12cfc tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:51.577790 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6d77861f-f458-4983-8c2e-ff0518c12cfc tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:51.584727 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6d77861f-f458-4983-8c2e-ff0518c12cfc tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:51.585218 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6d77861f-f458-4983-8c2e-ff0518c12cfc tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:51.586038 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6d77861f-f458-4983-8c2e-ff0518c12cfc tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:51.586488 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6d77861f-f458-4983-8c2e-ff0518c12cfc tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:51.722433 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-6d77861f-f458-4983-8c2e-ff0518c12cfc tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:51.732006 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6d77861f-f458-4983-8c2e-ff0518c12cfc tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8" status: 200 len: 1319 microversion: 2.1 time: 0.159320 Oct 13 04:23:51.732821 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 449/891] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:51 2021] GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:52.754940 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-028c5d9d-c27b-49ee-9380-f14cda794337 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:52.755485 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-028c5d9d-c27b-49ee-9380-f14cda794337 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:52.761911 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-028c5d9d-c27b-49ee-9380-f14cda794337 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:52.762347 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-028c5d9d-c27b-49ee-9380-f14cda794337 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:52.763186 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-028c5d9d-c27b-49ee-9380-f14cda794337 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:52.763578 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-028c5d9d-c27b-49ee-9380-f14cda794337 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:52.898131 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-028c5d9d-c27b-49ee-9380-f14cda794337 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:52.906075 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-028c5d9d-c27b-49ee-9380-f14cda794337 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8" status: 200 len: 1509 microversion: 2.1 time: 0.157057 Oct 13 04:23:52.906987 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 443/892] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:23:52 2021] GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:57.888270 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-0f973557-fcb1-4ce6-b615-438b1db055eb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:57.888990 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-0f973557-fcb1-4ce6-b615-438b1db055eb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:57.897199 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0f973557-fcb1-4ce6-b615-438b1db055eb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:57.897911 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0f973557-fcb1-4ce6-b615-438b1db055eb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:57.898673 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0f973557-fcb1-4ce6-b615-438b1db055eb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:57.899089 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0f973557-fcb1-4ce6-b615-438b1db055eb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:57.928517 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-0f973557-fcb1-4ce6-b615-438b1db055eb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/os-volume_attachments/823173b8-af8b-4201-9f1f-2695a83ceb29" status: 200 len: 194 microversion: 2.20 time: 0.045415 Oct 13 04:23:57.929244 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 450/893] 10.222.0.55 () {60 vars in 1453 bytes} [Wed Oct 13 04:23:57 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/os-volume_attachments/823173b8-af8b-4201-9f1f-2695a83ceb29 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:23:57.989985 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-eced54a5-3c9b-4f67-bd5f-52384db41fa7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:57.990460 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-eced54a5-3c9b-4f67-bd5f-52384db41fa7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:57.996340 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-eced54a5-3c9b-4f67-bd5f-52384db41fa7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:57.996779 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-eced54a5-3c9b-4f67-bd5f-52384db41fa7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:57.997527 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-eced54a5-3c9b-4f67-bd5f-52384db41fa7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:57.997979 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-eced54a5-3c9b-4f67-bd5f-52384db41fa7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:58.081369 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-eced54a5-3c9b-4f67-bd5f-52384db41fa7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lazy-loading 'services' on Instance uuid 3c2b8a8f-db02-4581-b497-1f4caa68240f {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:23:58.151477 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-eced54a5-3c9b-4f67-bd5f-52384db41fa7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/os-volume_attachments/823173b8-af8b-4201-9f1f-2695a83ceb29" status: 202 len: 0 microversion: 2.20 time: 0.165015 Oct 13 04:23:58.151992 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 444/894] 10.222.0.55 () {60 vars in 1456 bytes} [Wed Oct 13 04:23:57 2021] DELETE /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/os-volume_attachments/823173b8-af8b-4201-9f1f-2695a83ceb29 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:23:58.161071 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7919de6a-6b9d-46d7-83fc-8691b4d495c9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:58.162014 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7919de6a-6b9d-46d7-83fc-8691b4d495c9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:58.169145 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7919de6a-6b9d-46d7-83fc-8691b4d495c9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:58.169686 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7919de6a-6b9d-46d7-83fc-8691b4d495c9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:58.170538 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7919de6a-6b9d-46d7-83fc-8691b4d495c9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:58.170998 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7919de6a-6b9d-46d7-83fc-8691b4d495c9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:58.203322 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7919de6a-6b9d-46d7-83fc-8691b4d495c9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046666 Oct 13 04:23:58.203871 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 451/895] 10.222.0.55 () {60 vars in 1342 bytes} [Wed Oct 13 04:23:58 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:23:59.216078 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-60928dd4-ec8a-4173-81a3-c5a0f9f9dcb4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:59.217123 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-60928dd4-ec8a-4173-81a3-c5a0f9f9dcb4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:59.223855 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-60928dd4-ec8a-4173-81a3-c5a0f9f9dcb4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:59.224298 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-60928dd4-ec8a-4173-81a3-c5a0f9f9dcb4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:59.225056 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-60928dd4-ec8a-4173-81a3-c5a0f9f9dcb4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:59.225477 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-60928dd4-ec8a-4173-81a3-c5a0f9f9dcb4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:59.255010 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-60928dd4-ec8a-4173-81a3-c5a0f9f9dcb4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043135 Oct 13 04:23:59.255567 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 445/896] 10.222.0.55 () {60 vars in 1342 bytes} [Wed Oct 13 04:23:59 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:23:59.314016 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-71efe304-bf50-418f-a46f-319ba3c38172 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:59.314625 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-71efe304-bf50-418f-a46f-319ba3c38172 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:59.321046 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-71efe304-bf50-418f-a46f-319ba3c38172 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:59.321463 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-71efe304-bf50-418f-a46f-319ba3c38172 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:59.322241 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-71efe304-bf50-418f-a46f-319ba3c38172 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:59.322691 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-71efe304-bf50-418f-a46f-319ba3c38172 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:59.347137 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-71efe304-bf50-418f-a46f-319ba3c38172 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Going to try to terminate instance {{(pid=108260) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:23:59.426771 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-71efe304-bf50-418f-a46f-319ba3c38172 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 204 len: 0 microversion: 2.20 time: 0.116337 Oct 13 04:23:59.427359 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 452/897] 10.222.0.55 () {60 vars in 1279 bytes} [Wed Oct 13 04:23:59 2021] DELETE /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 04:23:59.436017 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1111cf5b-5d53-49e4-8d81-26c9e996e7be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:23:59.436612 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1111cf5b-5d53-49e4-8d81-26c9e996e7be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:23:59.442378 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1111cf5b-5d53-49e4-8d81-26c9e996e7be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:59.442809 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1111cf5b-5d53-49e4-8d81-26c9e996e7be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:59.443555 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1111cf5b-5d53-49e4-8d81-26c9e996e7be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:23:59.443972 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1111cf5b-5d53-49e4-8d81-26c9e996e7be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:23:59.574103 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1111cf5b-5d53-49e4-8d81-26c9e996e7be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:59.581652 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1111cf5b-5d53-49e4-8d81-26c9e996e7be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:59.583158 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1111cf5b-5d53-49e4-8d81-26c9e996e7be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:23:59.584309 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1111cf5b-5d53-49e4-8d81-26c9e996e7be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1721 microversion: 2.20 time: 0.152285 Oct 13 04:23:59.584854 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 446/898] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:23:59 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:24:00.603454 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-0aab6d78-99ee-4436-aa2b-ff839588c329 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:00.604159 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-0aab6d78-99ee-4436-aa2b-ff839588c329 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:00.611042 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0aab6d78-99ee-4436-aa2b-ff839588c329 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:00.611486 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0aab6d78-99ee-4436-aa2b-ff839588c329 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:00.612490 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0aab6d78-99ee-4436-aa2b-ff839588c329 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:00.612952 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0aab6d78-99ee-4436-aa2b-ff839588c329 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:00.736860 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-0aab6d78-99ee-4436-aa2b-ff839588c329 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:00.744702 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-0aab6d78-99ee-4436-aa2b-ff839588c329 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:00.746195 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-0aab6d78-99ee-4436-aa2b-ff839588c329 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:00.747338 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-0aab6d78-99ee-4436-aa2b-ff839588c329 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1721 microversion: 2.20 time: 0.148068 Oct 13 04:24:00.747888 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 453/899] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:24:00 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:24:01.765687 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f34ea662-f11a-47d3-aaa8-92ed4cca964c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:01.766372 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f34ea662-f11a-47d3-aaa8-92ed4cca964c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:01.772729 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f34ea662-f11a-47d3-aaa8-92ed4cca964c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:01.773166 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f34ea662-f11a-47d3-aaa8-92ed4cca964c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:01.774034 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f34ea662-f11a-47d3-aaa8-92ed4cca964c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:01.774642 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f34ea662-f11a-47d3-aaa8-92ed4cca964c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:02.307661 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f34ea662-f11a-47d3-aaa8-92ed4cca964c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:02.315837 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f34ea662-f11a-47d3-aaa8-92ed4cca964c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:02.317330 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f34ea662-f11a-47d3-aaa8-92ed4cca964c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:02.318509 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f34ea662-f11a-47d3-aaa8-92ed4cca964c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1721 microversion: 2.20 time: 0.556655 Oct 13 04:24:02.319080 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 447/900] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:24:01 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1721 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:24:02.852774 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-92d77d94-4d3e-4d4e-bad1-0e73048f20f5 req-913de6bf-73bf-412b-b5b3-c08a7239b823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c2b8a8f-db02-4581-b497-1f4caa68240f", "name": "network-vif-deleted", "tag": "819b5060-2257-431d-a719-93e3e23c273c"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:02.854844 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:24:02.854844 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:24:02.862967 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-92d77d94-4d3e-4d4e-bad1-0e73048f20f5 req-913de6bf-73bf-412b-b5b3-c08a7239b823 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:02.863408 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-92d77d94-4d3e-4d4e-bad1-0e73048f20f5 req-913de6bf-73bf-412b-b5b3-c08a7239b823 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:02.878110 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-92d77d94-4d3e-4d4e-bad1-0e73048f20f5 req-913de6bf-73bf-412b-b5b3-c08a7239b823 service nova] Creating event network-vif-deleted:819b5060-2257-431d-a719-93e3e23c273c for instance 3c2b8a8f-db02-4581-b497-1f4caa68240f on hv-cinder-81275 Oct 13 04:24:02.883065 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-92d77d94-4d3e-4d4e-bad1-0e73048f20f5 req-913de6bf-73bf-412b-b5b3-c08a7239b823 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034304 Oct 13 04:24:02.883783 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 454/901] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:24:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:24:03.336877 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f720366b-5e3a-4d02-82bf-5507d4158574 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:03.337568 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f720366b-5e3a-4d02-82bf-5507d4158574 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:03.343884 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f720366b-5e3a-4d02-82bf-5507d4158574 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:03.344308 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f720366b-5e3a-4d02-82bf-5507d4158574 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:03.345287 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f720366b-5e3a-4d02-82bf-5507d4158574 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:03.346055 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f720366b-5e3a-4d02-82bf-5507d4158574 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:03.386385 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f720366b-5e3a-4d02-82bf-5507d4158574 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:03.387080 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f720366b-5e3a-4d02-82bf-5507d4158574 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:03.387686 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-f720366b-5e3a-4d02-82bf-5507d4158574 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lazy-loading 'fault' on Instance uuid 3c2b8a8f-db02-4581-b497-1f4caa68240f {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:24:03.429406 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f720366b-5e3a-4d02-82bf-5507d4158574 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:03.437728 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f720366b-5e3a-4d02-82bf-5507d4158574 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:03.439233 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-f720366b-5e3a-4d02-82bf-5507d4158574 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:03.440393 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f720366b-5e3a-4d02-82bf-5507d4158574 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 200 len: 1370 microversion: 2.20 time: 0.107699 Oct 13 04:24:03.440951 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 448/902] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:24:03 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 1370 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:24:04.459359 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c501b846-bc0d-4d65-8798-0ade571b26cf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:04.460012 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c501b846-bc0d-4d65-8798-0ade571b26cf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:04.466763 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c501b846-bc0d-4d65-8798-0ade571b26cf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:04.467202 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c501b846-bc0d-4d65-8798-0ade571b26cf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:04.467963 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c501b846-bc0d-4d65-8798-0ade571b26cf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:04.468393 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c501b846-bc0d-4d65-8798-0ade571b26cf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:04.483578 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-c501b846-bc0d-4d65-8798-0ade571b26cf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] HTTP exception thrown: Instance 3c2b8a8f-db02-4581-b497-1f4caa68240f could not be found. Oct 13 04:24:04.484192 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c501b846-bc0d-4d65-8798-0ade571b26cf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Returning 404 to user: Instance 3c2b8a8f-db02-4581-b497-1f4caa68240f could not be found. {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:24:04.485028 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c501b846-bc0d-4d65-8798-0ade571b26cf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 404 len: 111 microversion: 2.20 time: 0.029846 Oct 13 04:24:04.485583 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 455/903] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:24:04 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 04:24:04.494304 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-75f68e60-a8ab-4b3d-8d64-c70c5472b623 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '.version_select at 0x7f33f6b30a60>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:04.522684 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-75f68e60-a8ab-4b3d-8d64-c70c5472b623 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-975720806" status: 204 len: 0 microversion: 2.20 time: 0.032084 Oct 13 04:24:04.523418 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 449/904] 10.222.0.55 () {60 vars in 1258 bytes} [Wed Oct 13 04:24:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-975720806 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 04:24:05.249910 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6bb09aac-cda8-4424-950c-21f67a15c98f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'create', calling method: .version_select at 0x7f33f6cf3280>, body: {"keypair": {"name": "tempest-keypair-142726240"}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:05.269726 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-6bb09aac-cda8-4424-950c-21f67a15c98f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Getting quotas for project d168ef71e112452db0a5035cfc0e4b2b. Resources: {'key_pairs'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:24:05.274143 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-6bb09aac-cda8-4424-950c-21f67a15c98f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Getting quotas for user 6353e635051e487cb5ae8f73097aab5e and project d168ef71e112452db0a5035cfc0e4b2b. Resources: {'key_pairs'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:24:05.286721 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6bb09aac-cda8-4424-950c-21f67a15c98f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [95d492d8-b02c-49f7-a51b-f3d54f737c5d] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 04:24:06.314841 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO oslo.messaging._drivers.impl_rabbit [None req-6bb09aac-cda8-4424-950c-21f67a15c98f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [95d492d8-b02c-49f7-a51b-f3d54f737c5d] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 42656. Oct 13 04:24:06.891249 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-6bb09aac-cda8-4424-950c-21f67a15c98f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Getting quotas for project d168ef71e112452db0a5035cfc0e4b2b. Resources: {'key_pairs'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:24:06.894651 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-6bb09aac-cda8-4424-950c-21f67a15c98f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Getting quotas for user 6353e635051e487cb5ae8f73097aab5e and project d168ef71e112452db0a5035cfc0e4b2b. Resources: {'key_pairs'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:24:06.907502 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6bb09aac-cda8-4424-950c-21f67a15c98f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.661499 Oct 13 04:24:06.908089 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 456/905] 10.222.0.55 () {62 vars in 1198 bytes} [Wed Oct 13 04:24:05 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1663 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Oct 13 04:24:08.220984 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c0b00b90-212e-4799-92ec-cf81455687aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-49834434", "imageRef": "4f468f34-171a-4b6e-a0cd-2e4c6fcda23d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c4537c4-626c-4872-8f08-761847ce7780"}], "security_groups": [{"name": "tempest-securitygroup--746520491"}], "key_name": "tempest-keypair-142726240", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:08.316044 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.network.neutron [None req-c0b00b90-212e-4799-92ec-cf81455687aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] validate_networks() for [('1c4537c4-626c-4872-8f08-761847ce7780', None, None, None, None, None)] {{(pid=108259) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:24:08.742224 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-c0b00b90-212e-4799-92ec-cf81455687aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Flavor limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:24:08.742956 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-c0b00b90-212e-4799-92ec-cf81455687aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Image limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:24:08.743433 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-c0b00b90-212e-4799-92ec-cf81455687aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Flavor pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:24:08.743842 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-c0b00b90-212e-4799-92ec-cf81455687aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Image pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:24:08.744254 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-c0b00b90-212e-4799-92ec-cf81455687aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:24:08.753968 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c0b00b90-212e-4799-92ec-cf81455687aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:08.754350 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c0b00b90-212e-4799-92ec-cf81455687aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:08.755145 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c0b00b90-212e-4799-92ec-cf81455687aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:08.755579 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c0b00b90-212e-4799-92ec-cf81455687aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:08.772571 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-c0b00b90-212e-4799-92ec-cf81455687aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Getting quotas for project d168ef71e112452db0a5035cfc0e4b2b. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:24:08.776725 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-c0b00b90-212e-4799-92ec-cf81455687aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Getting quotas for user 6353e635051e487cb5ae8f73097aab5e and project d168ef71e112452db0a5035cfc0e4b2b. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:24:08.788225 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c0b00b90-212e-4799-92ec-cf81455687aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Going to run 1 instances... {{(pid=108259) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:24:08.791310 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c0b00b90-212e-4799-92ec-cf81455687aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f468f34-171a-4b6e-a0cd-2e4c6fcda23d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:24:08.852056 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c0b00b90-212e-4799-92ec-cf81455687aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.635186 Oct 13 04:24:08.852695 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 450/906] 10.222.0.55 () {62 vars in 1187 bytes} [Wed Oct 13 04:24:08 2021] POST /compute/v2.1/servers => generated 401 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 04:24:08.863105 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4d07e4aa-384e-4835-8bbd-be4bd4ff1778 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:08.863782 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4d07e4aa-384e-4835-8bbd-be4bd4ff1778 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:08.922492 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4d07e4aa-384e-4835-8bbd-be4bd4ff1778 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:08.929514 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4d07e4aa-384e-4835-8bbd-be4bd4ff1778 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:08.931079 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4d07e4aa-384e-4835-8bbd-be4bd4ff1778 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:08.932175 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4d07e4aa-384e-4835-8bbd-be4bd4ff1778 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1279 microversion: 2.20 time: 0.073046 Oct 13 04:24:08.932714 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 457/907] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:24:08 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1279 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:24:09.950476 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b7ae1094-a82e-4c36-ad97-62ab8ea20b33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:09.951080 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b7ae1094-a82e-4c36-ad97-62ab8ea20b33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:09.959454 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b7ae1094-a82e-4c36-ad97-62ab8ea20b33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:09.959891 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b7ae1094-a82e-4c36-ad97-62ab8ea20b33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:09.960657 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b7ae1094-a82e-4c36-ad97-62ab8ea20b33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:09.961076 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b7ae1094-a82e-4c36-ad97-62ab8ea20b33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:10.028298 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b7ae1094-a82e-4c36-ad97-62ab8ea20b33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:10.036900 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b7ae1094-a82e-4c36-ad97-62ab8ea20b33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:10.038232 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b7ae1094-a82e-4c36-ad97-62ab8ea20b33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:10.039347 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b7ae1094-a82e-4c36-ad97-62ab8ea20b33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1349 microversion: 2.20 time: 0.092721 Oct 13 04:24:10.039970 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 451/908] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:24:09 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:24:11.057582 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a3d54a65-b9f7-44dc-b9d8-54a4db113ec8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:11.058163 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a3d54a65-b9f7-44dc-b9d8-54a4db113ec8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:11.063969 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a3d54a65-b9f7-44dc-b9d8-54a4db113ec8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:11.064409 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a3d54a65-b9f7-44dc-b9d8-54a4db113ec8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:11.065407 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a3d54a65-b9f7-44dc-b9d8-54a4db113ec8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:11.065864 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a3d54a65-b9f7-44dc-b9d8-54a4db113ec8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:11.258608 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a3d54a65-b9f7-44dc-b9d8-54a4db113ec8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:11.266802 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a3d54a65-b9f7-44dc-b9d8-54a4db113ec8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:11.268222 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a3d54a65-b9f7-44dc-b9d8-54a4db113ec8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:11.269350 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a3d54a65-b9f7-44dc-b9d8-54a4db113ec8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1404 microversion: 2.20 time: 0.215703 Oct 13 04:24:11.269936 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 458/909] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:24:11 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1404 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:24:11.307306 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-e43164ed-3fa4-40f0-bf7b-5404c59485df req-f7a2ef94-e10d-434f-aac0-c8a341c2dee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6451d1-6399-4efc-8b6a-0e57ee0610b8", "tag": "b7c271f3-64be-4491-904a-f29a7f6c6c8a"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:11.309316 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:24:11.309316 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:24:11.316942 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-e43164ed-3fa4-40f0-bf7b-5404c59485df req-f7a2ef94-e10d-434f-aac0-c8a341c2dee2 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:11.317420 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-e43164ed-3fa4-40f0-bf7b-5404c59485df req-f7a2ef94-e10d-434f-aac0-c8a341c2dee2 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:11.329570 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-e43164ed-3fa4-40f0-bf7b-5404c59485df req-f7a2ef94-e10d-434f-aac0-c8a341c2dee2 service nova] Creating event network-changed:b7c271f3-64be-4491-904a-f29a7f6c6c8a for instance 7a6451d1-6399-4efc-8b6a-0e57ee0610b8 on hv-cinder-81275 Oct 13 04:24:11.335287 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-e43164ed-3fa4-40f0-bf7b-5404c59485df req-f7a2ef94-e10d-434f-aac0-c8a341c2dee2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031897 Oct 13 04:24:11.335889 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 452/910] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:24:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:24:12.287788 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5de9b125-8c94-40ad-8f0d-d068cbccee70 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:12.288382 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5de9b125-8c94-40ad-8f0d-d068cbccee70 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:12.294424 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5de9b125-8c94-40ad-8f0d-d068cbccee70 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:12.294858 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5de9b125-8c94-40ad-8f0d-d068cbccee70 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:12.295660 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5de9b125-8c94-40ad-8f0d-d068cbccee70 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:12.296026 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5de9b125-8c94-40ad-8f0d-d068cbccee70 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:12.523312 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5de9b125-8c94-40ad-8f0d-d068cbccee70 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:12.531704 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5de9b125-8c94-40ad-8f0d-d068cbccee70 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:12.533173 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5de9b125-8c94-40ad-8f0d-d068cbccee70 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:12.534292 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5de9b125-8c94-40ad-8f0d-d068cbccee70 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1404 microversion: 2.20 time: 0.250254 Oct 13 04:24:12.534881 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 459/911] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:24:12 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1404 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:24:13.556540 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-bc0569ef-9deb-4a25-b6cd-c25935716ff4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:13.557228 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-bc0569ef-9deb-4a25-b6cd-c25935716ff4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:13.559716 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d01a0c62-7b9c-477d-97a0-d2f19442b43d] AMQP server on 10.222.0.55:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 13 04:24:13.564702 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bc0569ef-9deb-4a25-b6cd-c25935716ff4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:13.565148 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bc0569ef-9deb-4a25-b6cd-c25935716ff4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:13.565950 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bc0569ef-9deb-4a25-b6cd-c25935716ff4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:13.566378 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bc0569ef-9deb-4a25-b6cd-c25935716ff4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:13.691957 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-bc0569ef-9deb-4a25-b6cd-c25935716ff4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:13.702570 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-bc0569ef-9deb-4a25-b6cd-c25935716ff4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:13.704739 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-bc0569ef-9deb-4a25-b6cd-c25935716ff4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:13.706470 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-bc0569ef-9deb-4a25-b6cd-c25935716ff4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1404 microversion: 2.20 time: 0.155889 Oct 13 04:24:13.707276 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 453/912] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:24:13 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:24:14.734758 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-48148cd5-a486-4cd3-bce7-09a4e3e74c38 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:14.735755 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-48148cd5-a486-4cd3-bce7-09a4e3e74c38 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:14.739682 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e1589c2-9844-4625-ad74-f68a0a288b57] AMQP server on 10.222.0.55:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 13 04:24:14.745655 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-48148cd5-a486-4cd3-bce7-09a4e3e74c38 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:14.746127 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-48148cd5-a486-4cd3-bce7-09a4e3e74c38 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:14.746879 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-48148cd5-a486-4cd3-bce7-09a4e3e74c38 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:14.747303 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-48148cd5-a486-4cd3-bce7-09a4e3e74c38 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:14.871659 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-48148cd5-a486-4cd3-bce7-09a4e3e74c38 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:14.883635 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-48148cd5-a486-4cd3-bce7-09a4e3e74c38 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:14.885470 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-48148cd5-a486-4cd3-bce7-09a4e3e74c38 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:14.887046 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-48148cd5-a486-4cd3-bce7-09a4e3e74c38 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1404 microversion: 2.20 time: 0.158385 Oct 13 04:24:14.887813 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 460/913] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:24:14 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:24:15.915153 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ea7093bb-2811-45cf-85db-1c361244e14c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:15.916067 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ea7093bb-2811-45cf-85db-1c361244e14c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:15.933224 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ea7093bb-2811-45cf-85db-1c361244e14c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:15.933701 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ea7093bb-2811-45cf-85db-1c361244e14c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:15.934460 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ea7093bb-2811-45cf-85db-1c361244e14c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:15.934883 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ea7093bb-2811-45cf-85db-1c361244e14c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:15.939761 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO oslo.messaging._drivers.impl_rabbit [-] [d01a0c62-7b9c-477d-97a0-d2f19442b43d] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 42732. Oct 13 04:24:16.296170 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ea7093bb-2811-45cf-85db-1c361244e14c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:16.304548 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ea7093bb-2811-45cf-85db-1c361244e14c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:16.306069 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ea7093bb-2811-45cf-85db-1c361244e14c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:16.307196 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ea7093bb-2811-45cf-85db-1c361244e14c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1404 microversion: 2.20 time: 0.398597 Oct 13 04:24:16.307756 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 454/914] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:24:15 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1404 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:24:17.329089 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2e471c9b-8737-4bf6-9fa0-35f30a72d07a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:17.329708 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-2e471c9b-8737-4bf6-9fa0-35f30a72d07a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:17.347588 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2e471c9b-8737-4bf6-9fa0-35f30a72d07a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:17.348026 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2e471c9b-8737-4bf6-9fa0-35f30a72d07a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:17.348795 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2e471c9b-8737-4bf6-9fa0-35f30a72d07a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:17.349209 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2e471c9b-8737-4bf6-9fa0-35f30a72d07a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:17.355072 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e1589c2-9844-4625-ad74-f68a0a288b57] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 42740. Oct 13 04:24:17.472275 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-2e471c9b-8737-4bf6-9fa0-35f30a72d07a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:17.480606 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-2e471c9b-8737-4bf6-9fa0-35f30a72d07a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:17.482202 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-2e471c9b-8737-4bf6-9fa0-35f30a72d07a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:17.483383 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-2e471c9b-8737-4bf6-9fa0-35f30a72d07a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1404 microversion: 2.20 time: 0.160244 Oct 13 04:24:17.483927 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 461/915] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:24:17 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:24:18.501972 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1947f691-80aa-4033-aefb-3d92d21ff055 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:18.502748 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1947f691-80aa-4033-aefb-3d92d21ff055 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:18.514383 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1947f691-80aa-4033-aefb-3d92d21ff055 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:18.514383 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1947f691-80aa-4033-aefb-3d92d21ff055 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:18.514383 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1947f691-80aa-4033-aefb-3d92d21ff055 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:18.514383 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1947f691-80aa-4033-aefb-3d92d21ff055 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:18.658191 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1947f691-80aa-4033-aefb-3d92d21ff055 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:18.666636 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1947f691-80aa-4033-aefb-3d92d21ff055 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:18.668112 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1947f691-80aa-4033-aefb-3d92d21ff055 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:18.669242 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1947f691-80aa-4033-aefb-3d92d21ff055 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1404 microversion: 2.20 time: 0.172240 Oct 13 04:24:18.669839 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 455/916] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:24:18 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:24:19.604706 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a0f6bb46-3709-47b5-93dd-4b8b4cfef474 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4455585-f4e4-4996-88a4-ecc8c6b68100", "device": "/dev/sdb"}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:19.606283 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a0f6bb46-3709-47b5-93dd-4b8b4cfef474 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:19.612327 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a0f6bb46-3709-47b5-93dd-4b8b4cfef474 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:19.612764 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a0f6bb46-3709-47b5-93dd-4b8b4cfef474 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:19.613557 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a0f6bb46-3709-47b5-93dd-4b8b4cfef474 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:19.614005 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a0f6bb46-3709-47b5-93dd-4b8b4cfef474 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:19.694291 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-36c456eb-44b3-4fe1-92ff-6f164a356b17 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:19.694862 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-36c456eb-44b3-4fe1-92ff-6f164a356b17 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:19.701878 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-36c456eb-44b3-4fe1-92ff-6f164a356b17 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:19.702312 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-36c456eb-44b3-4fe1-92ff-6f164a356b17 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:19.703077 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-36c456eb-44b3-4fe1-92ff-6f164a356b17 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:19.703465 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-36c456eb-44b3-4fe1-92ff-6f164a356b17 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:19.828313 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-36c456eb-44b3-4fe1-92ff-6f164a356b17 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:19.837010 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-36c456eb-44b3-4fe1-92ff-6f164a356b17 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:19.838618 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-36c456eb-44b3-4fe1-92ff-6f164a356b17 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:19.839876 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-36c456eb-44b3-4fe1-92ff-6f164a356b17 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1404 microversion: 2.20 time: 0.151803 Oct 13 04:24:19.840419 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 456/917] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:24:19 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:24:19.860731 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a0f6bb46-3709-47b5-93dd-4b8b4cfef474 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "POST /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262177 Oct 13 04:24:19.861370 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 462/918] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Oct 13 04:24:19 2021] POST /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:24:20.245927 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-4deb55cc-487a-40cd-bef5-0d03be019fc0 req-36324206-475b-495d-91bd-b99ad4b85a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6451d1-6399-4efc-8b6a-0e57ee0610b8", "name": "network-vif-plugged", "status": "completed", "tag": "b7c271f3-64be-4491-904a-f29a7f6c6c8a"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:20.248035 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:24:20.248035 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:24:20.255704 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-4deb55cc-487a-40cd-bef5-0d03be019fc0 req-36324206-475b-495d-91bd-b99ad4b85a4e service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:20.256192 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-4deb55cc-487a-40cd-bef5-0d03be019fc0 req-36324206-475b-495d-91bd-b99ad4b85a4e service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:20.268369 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-4deb55cc-487a-40cd-bef5-0d03be019fc0 req-36324206-475b-495d-91bd-b99ad4b85a4e service nova] Creating event network-vif-plugged:b7c271f3-64be-4491-904a-f29a7f6c6c8a for instance 7a6451d1-6399-4efc-8b6a-0e57ee0610b8 on hv-cinder-81275 Oct 13 04:24:20.274366 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-4deb55cc-487a-40cd-bef5-0d03be019fc0 req-36324206-475b-495d-91bd-b99ad4b85a4e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032038 Oct 13 04:24:20.275228 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 457/919] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:24:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:24:20.863612 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f452c359-522c-40d2-a64d-54e30bc33774 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:20.864651 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f452c359-522c-40d2-a64d-54e30bc33774 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:20.873203 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f452c359-522c-40d2-a64d-54e30bc33774 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:20.873640 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f452c359-522c-40d2-a64d-54e30bc33774 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:20.874427 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f452c359-522c-40d2-a64d-54e30bc33774 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:20.874860 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f452c359-522c-40d2-a64d-54e30bc33774 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:21.018811 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f452c359-522c-40d2-a64d-54e30bc33774 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:21.027289 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f452c359-522c-40d2-a64d-54e30bc33774 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:21.028795 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f452c359-522c-40d2-a64d-54e30bc33774 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:21.029928 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f452c359-522c-40d2-a64d-54e30bc33774 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1404 microversion: 2.20 time: 0.174107 Oct 13 04:24:21.030486 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 463/920] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:24:20 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1404 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:24:22.053761 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4aefe6f3-263d-4226-ba1d-8feefef43985 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:22.054453 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4aefe6f3-263d-4226-ba1d-8feefef43985 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:22.060769 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4aefe6f3-263d-4226-ba1d-8feefef43985 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:22.061226 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4aefe6f3-263d-4226-ba1d-8feefef43985 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:22.062026 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4aefe6f3-263d-4226-ba1d-8feefef43985 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:22.062454 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4aefe6f3-263d-4226-ba1d-8feefef43985 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:22.189584 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-4aefe6f3-263d-4226-ba1d-8feefef43985 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:22.198279 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-4aefe6f3-263d-4226-ba1d-8feefef43985 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:22.199747 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-4aefe6f3-263d-4226-ba1d-8feefef43985 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:22.200889 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4aefe6f3-263d-4226-ba1d-8feefef43985 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1595 microversion: 2.20 time: 0.151852 Oct 13 04:24:22.201441 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 458/921] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:24:22 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1595 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:24:22.218261 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-89b9fc3c-1563-4b88-937a-6d85d0da18ab tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:22.218754 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-89b9fc3c-1563-4b88-937a-6d85d0da18ab tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:22.224877 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-89b9fc3c-1563-4b88-937a-6d85d0da18ab tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:22.225314 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-89b9fc3c-1563-4b88-937a-6d85d0da18ab tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:22.226099 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-89b9fc3c-1563-4b88-937a-6d85d0da18ab tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:22.226518 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-89b9fc3c-1563-4b88-937a-6d85d0da18ab tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:22.311822 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-89b9fc3c-1563-4b88-937a-6d85d0da18ab tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096840 Oct 13 04:24:22.312749 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 464/922] 10.222.0.55 () {60 vars in 1315 bytes} [Wed Oct 13 04:24:22 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:24:23.299368 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3581ee21-e5ea-4f46-a334-ef2f64e2c86c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:23.300510 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3581ee21-e5ea-4f46-a334-ef2f64e2c86c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:23.302258 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-e794bec0-da6c-4433-886f-96c67aca63e1 req-24910e75-3d47-4ec9-85fe-11a435ccd884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6451d1-6399-4efc-8b6a-0e57ee0610b8", "tag": "b7c271f3-64be-4491-904a-f29a7f6c6c8a"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:23.304336 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:24:23.304336 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:24:23.307186 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3581ee21-e5ea-4f46-a334-ef2f64e2c86c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:23.307701 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3581ee21-e5ea-4f46-a334-ef2f64e2c86c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:23.308529 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3581ee21-e5ea-4f46-a334-ef2f64e2c86c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:23.309024 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3581ee21-e5ea-4f46-a334-ef2f64e2c86c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:23.311696 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-e794bec0-da6c-4433-886f-96c67aca63e1 req-24910e75-3d47-4ec9-85fe-11a435ccd884 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:23.312340 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-e794bec0-da6c-4433-886f-96c67aca63e1 req-24910e75-3d47-4ec9-85fe-11a435ccd884 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:23.327220 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-e794bec0-da6c-4433-886f-96c67aca63e1 req-24910e75-3d47-4ec9-85fe-11a435ccd884 service nova] Creating event network-changed:b7c271f3-64be-4491-904a-f29a7f6c6c8a for instance 7a6451d1-6399-4efc-8b6a-0e57ee0610b8 on hv-cinder-81275 Oct 13 04:24:23.333325 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-e794bec0-da6c-4433-886f-96c67aca63e1 req-24910e75-3d47-4ec9-85fe-11a435ccd884 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035870 Oct 13 04:24:23.334015 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 465/923] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:24:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:24:23.382663 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3581ee21-e5ea-4f46-a334-ef2f64e2c86c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 14 microversion: 2.20 time: 0.087043 Oct 13 04:24:23.383451 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 459/924] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:23 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:24:24.394635 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7dcbb217-ffd6-41e1-95b7-e94af62178cc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:24.395659 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7dcbb217-ffd6-41e1-95b7-e94af62178cc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:24.402008 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7dcbb217-ffd6-41e1-95b7-e94af62178cc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:24.402450 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7dcbb217-ffd6-41e1-95b7-e94af62178cc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:24.403233 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7dcbb217-ffd6-41e1-95b7-e94af62178cc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:24.403622 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7dcbb217-ffd6-41e1-95b7-e94af62178cc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:24.462839 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7dcbb217-ffd6-41e1-95b7-e94af62178cc tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 14 microversion: 2.20 time: 0.072110 Oct 13 04:24:24.463638 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 466/925] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:24 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:24:25.479007 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-21e03304-72e3-4ce4-af4d-def2956d6567 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:25.480598 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-21e03304-72e3-4ce4-af4d-def2956d6567 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:25.491415 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-21e03304-72e3-4ce4-af4d-def2956d6567 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:25.492142 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-21e03304-72e3-4ce4-af4d-def2956d6567 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:25.493517 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-21e03304-72e3-4ce4-af4d-def2956d6567 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:25.493981 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-21e03304-72e3-4ce4-af4d-def2956d6567 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:25.566601 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-21e03304-72e3-4ce4-af4d-def2956d6567 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 14 microversion: 2.20 time: 0.094368 Oct 13 04:24:25.567257 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 460/926] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:25 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:24:26.579338 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f40a322d-c82b-4aed-8eed-a6ef40799c66 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:26.580340 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f40a322d-c82b-4aed-8eed-a6ef40799c66 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:26.587173 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f40a322d-c82b-4aed-8eed-a6ef40799c66 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:26.587607 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f40a322d-c82b-4aed-8eed-a6ef40799c66 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:26.588362 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f40a322d-c82b-4aed-8eed-a6ef40799c66 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:26.588791 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f40a322d-c82b-4aed-8eed-a6ef40799c66 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:26.652557 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f40a322d-c82b-4aed-8eed-a6ef40799c66 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 14 microversion: 2.20 time: 0.076910 Oct 13 04:24:26.653230 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 467/927] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:26 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:24:27.670680 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b308b73a-5492-4cfa-9b96-b622eddda42e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:27.672275 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b308b73a-5492-4cfa-9b96-b622eddda42e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:27.682793 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b308b73a-5492-4cfa-9b96-b622eddda42e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:27.683227 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b308b73a-5492-4cfa-9b96-b622eddda42e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:27.683975 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b308b73a-5492-4cfa-9b96-b622eddda42e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:27.684405 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b308b73a-5492-4cfa-9b96-b622eddda42e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:27.756410 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b308b73a-5492-4cfa-9b96-b622eddda42e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 14 microversion: 2.20 time: 0.092427 Oct 13 04:24:27.756927 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 461/928] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:27 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:24:28.772418 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e999d768-1bb2-4de2-88b9-bc7296190509 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:28.774161 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e999d768-1bb2-4de2-88b9-bc7296190509 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:28.785771 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e999d768-1bb2-4de2-88b9-bc7296190509 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:28.786506 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e999d768-1bb2-4de2-88b9-bc7296190509 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:28.787737 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e999d768-1bb2-4de2-88b9-bc7296190509 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:28.788434 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e999d768-1bb2-4de2-88b9-bc7296190509 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:30.422261 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e999d768-1bb2-4de2-88b9-bc7296190509 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 14 microversion: 2.20 time: 1.655855 Oct 13 04:24:30.423348 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 468/929] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:28 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 14 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:24:31.439664 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3508b4c1-6bf1-49d2-a2ff-9eb6add8183c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:31.441263 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3508b4c1-6bf1-49d2-a2ff-9eb6add8183c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:31.452020 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3508b4c1-6bf1-49d2-a2ff-9eb6add8183c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:31.452742 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3508b4c1-6bf1-49d2-a2ff-9eb6add8183c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:31.454048 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3508b4c1-6bf1-49d2-a2ff-9eb6add8183c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:31.454762 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3508b4c1-6bf1-49d2-a2ff-9eb6add8183c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:31.997805 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3508b4c1-6bf1-49d2-a2ff-9eb6add8183c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 14 microversion: 2.20 time: 0.564547 Oct 13 04:24:31.998863 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 462/930] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:31 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 14 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:24:33.014510 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4d55ddd9-09b7-41c8-ae7d-1478addf35c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:33.015510 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4d55ddd9-09b7-41c8-ae7d-1478addf35c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:33.023102 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4d55ddd9-09b7-41c8-ae7d-1478addf35c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:33.023559 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4d55ddd9-09b7-41c8-ae7d-1478addf35c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:33.024328 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4d55ddd9-09b7-41c8-ae7d-1478addf35c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:33.024761 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4d55ddd9-09b7-41c8-ae7d-1478addf35c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:33.086462 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4d55ddd9-09b7-41c8-ae7d-1478addf35c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 14 microversion: 2.20 time: 0.077133 Oct 13 04:24:33.087171 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 469/931] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:33 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:24:34.102547 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-66b3d81d-5ff7-4fac-bc7d-bae20c838005 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:34.104150 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-66b3d81d-5ff7-4fac-bc7d-bae20c838005 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:34.111660 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-66b3d81d-5ff7-4fac-bc7d-bae20c838005 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:34.112096 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-66b3d81d-5ff7-4fac-bc7d-bae20c838005 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:34.112856 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-66b3d81d-5ff7-4fac-bc7d-bae20c838005 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:34.113279 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-66b3d81d-5ff7-4fac-bc7d-bae20c838005 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:37.180464 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-66b3d81d-5ff7-4fac-bc7d-bae20c838005 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 14 microversion: 2.20 time: 3.084046 Oct 13 04:24:37.181446 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 463/932] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:34 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 14 bytes in 3087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:24:38.198147 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-729e58fe-a73c-45c6-9edd-826e68271e4b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:38.199853 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-729e58fe-a73c-45c6-9edd-826e68271e4b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:38.210535 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-729e58fe-a73c-45c6-9edd-826e68271e4b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:38.211264 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-729e58fe-a73c-45c6-9edd-826e68271e4b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:38.212512 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-729e58fe-a73c-45c6-9edd-826e68271e4b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:38.213214 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-729e58fe-a73c-45c6-9edd-826e68271e4b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:38.273209 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-729e58fe-a73c-45c6-9edd-826e68271e4b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 14 microversion: 2.20 time: 0.081709 Oct 13 04:24:38.273959 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 470/933] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:38 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:24:39.288300 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-344b0504-b082-4523-abb9-82553bd24a75 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:39.289552 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-344b0504-b082-4523-abb9-82553bd24a75 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:39.297591 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-344b0504-b082-4523-abb9-82553bd24a75 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:39.298016 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-344b0504-b082-4523-abb9-82553bd24a75 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:39.298767 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-344b0504-b082-4523-abb9-82553bd24a75 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:39.299235 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-344b0504-b082-4523-abb9-82553bd24a75 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:39.373028 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-344b0504-b082-4523-abb9-82553bd24a75 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 5948 microversion: 2.20 time: 0.090750 Oct 13 04:24:39.374042 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 464/934] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:39 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 5948 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:24:40.389454 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9f9a7f6a-f2c9-4d40-8233-7702ba49b547 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:40.391119 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9f9a7f6a-f2c9-4d40-8233-7702ba49b547 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:40.402082 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9f9a7f6a-f2c9-4d40-8233-7702ba49b547 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:40.402821 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9f9a7f6a-f2c9-4d40-8233-7702ba49b547 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:40.403969 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9f9a7f6a-f2c9-4d40-8233-7702ba49b547 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:40.404685 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9f9a7f6a-f2c9-4d40-8233-7702ba49b547 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:43.054573 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9f9a7f6a-f2c9-4d40-8233-7702ba49b547 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 19774 microversion: 2.20 time: 2.671289 Oct 13 04:24:43.055613 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 471/935] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:40 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 19774 bytes in 2674 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:24:44.073448 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3769e28e-a4bc-475a-8297-432b7809104c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:44.075084 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3769e28e-a4bc-475a-8297-432b7809104c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:44.085855 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3769e28e-a4bc-475a-8297-432b7809104c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:44.086580 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3769e28e-a4bc-475a-8297-432b7809104c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:44.088033 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3769e28e-a4bc-475a-8297-432b7809104c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:44.088734 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3769e28e-a4bc-475a-8297-432b7809104c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:44.165840 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3769e28e-a4bc-475a-8297-432b7809104c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 22322 microversion: 2.20 time: 0.098732 Oct 13 04:24:44.166826 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 465/936] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:44 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 22322 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:24:45.184753 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-cdb8162f-7190-4b67-bff9-df87cf6b3ab5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:45.186417 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-cdb8162f-7190-4b67-bff9-df87cf6b3ab5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:45.197275 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cdb8162f-7190-4b67-bff9-df87cf6b3ab5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:45.198033 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cdb8162f-7190-4b67-bff9-df87cf6b3ab5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:45.199318 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cdb8162f-7190-4b67-bff9-df87cf6b3ab5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:45.200039 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cdb8162f-7190-4b67-bff9-df87cf6b3ab5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:45.274550 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-cdb8162f-7190-4b67-bff9-df87cf6b3ab5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 23227 microversion: 2.20 time: 0.096637 Oct 13 04:24:45.275182 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 472/937] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:45 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 23227 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:24:46.288244 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3310d3a8-3e7f-4797-8e0b-73553b06d901 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:46.289236 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3310d3a8-3e7f-4797-8e0b-73553b06d901 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:46.296445 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3310d3a8-3e7f-4797-8e0b-73553b06d901 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:46.296887 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3310d3a8-3e7f-4797-8e0b-73553b06d901 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:46.297641 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3310d3a8-3e7f-4797-8e0b-73553b06d901 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:46.298117 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3310d3a8-3e7f-4797-8e0b-73553b06d901 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:46.388521 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3310d3a8-3e7f-4797-8e0b-73553b06d901 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 24748 microversion: 2.20 time: 0.103796 Oct 13 04:24:46.389711 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 466/938] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:46 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 24748 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:24:47.407053 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e3e46602-351e-466c-852d-abac128a3a8e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:47.408661 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e3e46602-351e-466c-852d-abac128a3a8e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:47.419824 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e3e46602-351e-466c-852d-abac128a3a8e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:47.420175 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e3e46602-351e-466c-852d-abac128a3a8e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:47.420931 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e3e46602-351e-466c-852d-abac128a3a8e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:47.421353 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e3e46602-351e-466c-852d-abac128a3a8e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:47.495782 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e3e46602-351e-466c-852d-abac128a3a8e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 26159 microversion: 2.20 time: 0.095729 Oct 13 04:24:47.496790 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 473/939] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:47 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 26159 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:24:47.725913 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f1df92e8-d5d8-4df6-b10d-a0aedc3f2c60 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:47.726491 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f1df92e8-d5d8-4df6-b10d-a0aedc3f2c60 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:47.733381 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f1df92e8-d5d8-4df6-b10d-a0aedc3f2c60 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:47.733848 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f1df92e8-d5d8-4df6-b10d-a0aedc3f2c60 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:47.734601 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f1df92e8-d5d8-4df6-b10d-a0aedc3f2c60 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:47.735021 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f1df92e8-d5d8-4df6-b10d-a0aedc3f2c60 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:47.817398 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-f1df92e8-d5d8-4df6-b10d-a0aedc3f2c60 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lazy-loading 'services' on Instance uuid 9173ac96-e73d-4283-ba7a-11545df2d4f8 {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:24:47.886847 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f1df92e8-d5d8-4df6-b10d-a0aedc3f2c60 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8/os-volume_attachments/a4455585-f4e4-4996-88a4-ecc8c6b68100" status: 202 len: 0 microversion: 2.1 time: 0.164988 Oct 13 04:24:47.887471 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 467/940] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Oct 13 04:24:47 2021] DELETE /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8/os-volume_attachments/a4455585-f4e4-4996-88a4-ecc8c6b68100 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:24:48.515091 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9d5d854e-e93c-4f8f-9f54-2b5acfd544e3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:48.516721 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9d5d854e-e93c-4f8f-9f54-2b5acfd544e3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:48.529055 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9d5d854e-e93c-4f8f-9f54-2b5acfd544e3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:48.529485 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9d5d854e-e93c-4f8f-9f54-2b5acfd544e3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:48.530683 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9d5d854e-e93c-4f8f-9f54-2b5acfd544e3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:48.531204 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9d5d854e-e93c-4f8f-9f54-2b5acfd544e3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:48.614046 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9d5d854e-e93c-4f8f-9f54-2b5acfd544e3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 27207 microversion: 2.20 time: 0.105784 Oct 13 04:24:48.614696 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 474/941] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:48 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 27207 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:24:49.002820 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-6281efee-b33b-42d0-a13e-626a98e29fd0 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:49.003353 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-6281efee-b33b-42d0-a13e-626a98e29fd0 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:49.009526 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6281efee-b33b-42d0-a13e-626a98e29fd0 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:49.009999 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6281efee-b33b-42d0-a13e-626a98e29fd0 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:49.010752 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6281efee-b33b-42d0-a13e-626a98e29fd0 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:49.011173 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6281efee-b33b-42d0-a13e-626a98e29fd0 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:49.036069 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-6281efee-b33b-42d0-a13e-626a98e29fd0 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Going to try to terminate instance {{(pid=108259) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:24:49.113491 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-6281efee-b33b-42d0-a13e-626a98e29fd0 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8" status: 204 len: 0 microversion: 2.1 time: 0.114669 Oct 13 04:24:49.114224 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 468/942] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:24:48 2021] DELETE /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:24:49.124022 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-871b38fd-bc0f-4390-9800-fa6b16554a34 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:49.124724 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-871b38fd-bc0f-4390-9800-fa6b16554a34 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:49.131687 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-871b38fd-bc0f-4390-9800-fa6b16554a34 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:49.132132 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-871b38fd-bc0f-4390-9800-fa6b16554a34 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:49.132894 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-871b38fd-bc0f-4390-9800-fa6b16554a34 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:49.133325 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-871b38fd-bc0f-4390-9800-fa6b16554a34 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:49.272092 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-871b38fd-bc0f-4390-9800-fa6b16554a34 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:49.282306 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-871b38fd-bc0f-4390-9800-fa6b16554a34 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8" status: 200 len: 1515 microversion: 2.1 time: 0.162545 Oct 13 04:24:49.282909 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 475/943] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:24:49 2021] GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:24:49.627306 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-51b94159-6788-4086-8889-2ff552d3f585 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:49.628381 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-51b94159-6788-4086-8889-2ff552d3f585 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:49.635370 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-51b94159-6788-4086-8889-2ff552d3f585 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:49.635840 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-51b94159-6788-4086-8889-2ff552d3f585 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:49.636640 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-51b94159-6788-4086-8889-2ff552d3f585 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:49.637092 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-51b94159-6788-4086-8889-2ff552d3f585 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:49.742488 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-51b94159-6788-4086-8889-2ff552d3f585 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 27631 microversion: 2.20 time: 0.119212 Oct 13 04:24:49.743446 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 469/944] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:49 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 27631 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:24:50.303487 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-807e1776-c02d-4ff1-bd73-4ff9806f19cb tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:50.304416 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-807e1776-c02d-4ff1-bd73-4ff9806f19cb tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:50.315123 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-807e1776-c02d-4ff1-bd73-4ff9806f19cb tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:50.315854 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-807e1776-c02d-4ff1-bd73-4ff9806f19cb tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:50.317101 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-807e1776-c02d-4ff1-bd73-4ff9806f19cb tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:50.317960 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-807e1776-c02d-4ff1-bd73-4ff9806f19cb tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:50.460613 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-807e1776-c02d-4ff1-bd73-4ff9806f19cb tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:50.468469 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-807e1776-c02d-4ff1-bd73-4ff9806f19cb tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8" status: 200 len: 1515 microversion: 2.1 time: 0.171194 Oct 13 04:24:50.469003 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 476/945] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:24:50 2021] GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:24:50.761876 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-eadaee60-8740-448c-98e2-22f5bf883701 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:50.763527 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-eadaee60-8740-448c-98e2-22f5bf883701 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:50.774597 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-eadaee60-8740-448c-98e2-22f5bf883701 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:50.775331 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-eadaee60-8740-448c-98e2-22f5bf883701 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:50.776600 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-eadaee60-8740-448c-98e2-22f5bf883701 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:50.777308 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-eadaee60-8740-448c-98e2-22f5bf883701 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:50.882262 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-eadaee60-8740-448c-98e2-22f5bf883701 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 27926 microversion: 2.20 time: 0.126753 Oct 13 04:24:50.883665 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 470/946] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:50 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 27926 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:24:51.490434 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-65f3403c-c64b-4733-8392-24074bb35c25 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:51.491059 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-65f3403c-c64b-4733-8392-24074bb35c25 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:51.497660 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-65f3403c-c64b-4733-8392-24074bb35c25 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:51.498132 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-65f3403c-c64b-4733-8392-24074bb35c25 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:51.498902 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-65f3403c-c64b-4733-8392-24074bb35c25 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:51.499326 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-65f3403c-c64b-4733-8392-24074bb35c25 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:51.713727 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-05912d25-4bb3-4c32-bab4-eeb7526c4408 req-a15fd3ab-de76-4ea9-9ca6-0e3d9bdf678f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9173ac96-e73d-4283-ba7a-11545df2d4f8", "name": "network-vif-deleted", "tag": "4df24fd3-b933-4fc4-a6b1-8dc465f59508"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:51.715189 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:24:51.715189 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:24:51.720137 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-65f3403c-c64b-4733-8392-24074bb35c25 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:51.724585 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-05912d25-4bb3-4c32-bab4-eeb7526c4408 req-a15fd3ab-de76-4ea9-9ca6-0e3d9bdf678f service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:51.725028 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-05912d25-4bb3-4c32-bab4-eeb7526c4408 req-a15fd3ab-de76-4ea9-9ca6-0e3d9bdf678f service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:51.727902 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-65f3403c-c64b-4733-8392-24074bb35c25 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8" status: 200 len: 1515 microversion: 2.1 time: 0.241455 Oct 13 04:24:51.728797 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 477/947] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:24:51 2021] GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8 => generated 1515 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:24:51.736734 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-05912d25-4bb3-4c32-bab4-eeb7526c4408 req-a15fd3ab-de76-4ea9-9ca6-0e3d9bdf678f service nova] Creating event network-vif-deleted:4df24fd3-b933-4fc4-a6b1-8dc465f59508 for instance 9173ac96-e73d-4283-ba7a-11545df2d4f8 on hv-cinder-81275 Oct 13 04:24:51.742705 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-05912d25-4bb3-4c32-bab4-eeb7526c4408 req-a15fd3ab-de76-4ea9-9ca6-0e3d9bdf678f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033032 Oct 13 04:24:51.743319 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 471/948] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:24:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:24:51.898382 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7a94fef9-506f-44a8-bb22-334a0fb768a4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:51.899628 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7a94fef9-506f-44a8-bb22-334a0fb768a4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:51.908376 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7a94fef9-506f-44a8-bb22-334a0fb768a4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:51.908958 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7a94fef9-506f-44a8-bb22-334a0fb768a4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:51.909992 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7a94fef9-506f-44a8-bb22-334a0fb768a4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:51.910547 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7a94fef9-506f-44a8-bb22-334a0fb768a4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:51.996780 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7a94fef9-506f-44a8-bb22-334a0fb768a4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 0.102646 Oct 13 04:24:51.997669 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 478/949] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:51 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:24:52.750391 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5116c8dd-a466-41bd-b31f-aae116cc3214 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:52.751507 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-5116c8dd-a466-41bd-b31f-aae116cc3214 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 9173ac96-e73d-4283-ba7a-11545df2d4f8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:52.762437 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5116c8dd-a466-41bd-b31f-aae116cc3214 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:52.763140 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5116c8dd-a466-41bd-b31f-aae116cc3214 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:52.764308 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5116c8dd-a466-41bd-b31f-aae116cc3214 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:52.764734 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5116c8dd-a466-41bd-b31f-aae116cc3214 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:52.778126 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-5116c8dd-a466-41bd-b31f-aae116cc3214 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] HTTP exception thrown: Instance 9173ac96-e73d-4283-ba7a-11545df2d4f8 could not be found. Oct 13 04:24:52.778697 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5116c8dd-a466-41bd-b31f-aae116cc3214 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Returning 404 to user: Instance 9173ac96-e73d-4283-ba7a-11545df2d4f8 could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:24:52.779506 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-5116c8dd-a466-41bd-b31f-aae116cc3214 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8" status: 404 len: 111 microversion: 2.1 time: 0.036010 Oct 13 04:24:52.780377 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 472/950] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:24:52 2021] GET /compute/v2.1/servers/9173ac96-e73d-4283-ba7a-11545df2d4f8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:24:53.015334 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-737a73d1-4362-4670-b0ff-747708f36375 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:53.016286 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-737a73d1-4362-4670-b0ff-747708f36375 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:53.024055 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-737a73d1-4362-4670-b0ff-747708f36375 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:53.024736 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-737a73d1-4362-4670-b0ff-747708f36375 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:53.025580 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-737a73d1-4362-4670-b0ff-747708f36375 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:53.026044 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-737a73d1-4362-4670-b0ff-747708f36375 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:53.103940 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-737a73d1-4362-4670-b0ff-747708f36375 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 0.095921 Oct 13 04:24:53.104597 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 479/951] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:53 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:24:54.120239 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ccc957de-68b2-4c54-9a2c-8ce65113d027 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:54.121966 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ccc957de-68b2-4c54-9a2c-8ce65113d027 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:54.132066 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ccc957de-68b2-4c54-9a2c-8ce65113d027 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:54.132797 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ccc957de-68b2-4c54-9a2c-8ce65113d027 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:54.134097 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ccc957de-68b2-4c54-9a2c-8ce65113d027 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:54.134809 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ccc957de-68b2-4c54-9a2c-8ce65113d027 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:57.294404 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ccc957de-68b2-4c54-9a2c-8ce65113d027 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 3.179881 Oct 13 04:24:57.297195 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 473/952] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:54 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 3184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:24:57.833413 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ee598c7e-e5b1-4dc8-9810-cac429889ab8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:57.834436 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ee598c7e-e5b1-4dc8-9810-cac429889ab8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:57.841242 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ee598c7e-e5b1-4dc8-9810-cac429889ab8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:57.841826 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ee598c7e-e5b1-4dc8-9810-cac429889ab8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:57.842586 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ee598c7e-e5b1-4dc8-9810-cac429889ab8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:57.843007 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ee598c7e-e5b1-4dc8-9810-cac429889ab8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:57.871471 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ee598c7e-e5b1-4dc8-9810-cac429889ab8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042145 Oct 13 04:24:57.872037 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 480/953] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:24:57 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:24:57.931651 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-30f67a12-d334-4703-b672-96984c8f4cf1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:57.932226 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-30f67a12-d334-4703-b672-96984c8f4cf1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:57.938949 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30f67a12-d334-4703-b672-96984c8f4cf1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:57.939390 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30f67a12-d334-4703-b672-96984c8f4cf1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:57.940146 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30f67a12-d334-4703-b672-96984c8f4cf1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:57.940569 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30f67a12-d334-4703-b672-96984c8f4cf1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:57.964452 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-30f67a12-d334-4703-b672-96984c8f4cf1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Going to try to terminate instance {{(pid=108259) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:24:57.970420 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-78e2eb9f-4d08-4897-b4a2-983d096af56b tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-792952520"}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:57.970943 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-78e2eb9f-4d08-4897-b4a2-983d096af56b tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:57.977382 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-78e2eb9f-4d08-4897-b4a2-983d096af56b tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:57.977848 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-78e2eb9f-4d08-4897-b4a2-983d096af56b tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:57.978600 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-78e2eb9f-4d08-4897-b4a2-983d096af56b tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:57.979022 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-78e2eb9f-4d08-4897-b4a2-983d096af56b tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:58.045601 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-30f67a12-d334-4703-b672-96984c8f4cf1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 204 len: 0 microversion: 2.1 time: 0.117595 Oct 13 04:24:58.046598 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 474/954] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:24:57 2021] DELETE /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:24:58.055466 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c2432d21-099e-421d-a9c8-6f6467cded53 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:58.056079 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c2432d21-099e-421d-a9c8-6f6467cded53 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:58.062065 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2432d21-099e-421d-a9c8-6f6467cded53 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:58.062513 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2432d21-099e-421d-a9c8-6f6467cded53 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:58.063276 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2432d21-099e-421d-a9c8-6f6467cded53 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:58.063700 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2432d21-099e-421d-a9c8-6f6467cded53 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:58.101327 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.network.security_group_api [None req-78e2eb9f-4d08-4897-b4a2-983d096af56b tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Removing security group 20e7d3f0-2df7-482e-a611-7c5c3227420e from port 0bd06624-1837-4923-9daf-aa14f17b4981 Oct 13 04:24:58.284966 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c2432d21-099e-421d-a9c8-6f6467cded53 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:58.292576 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c2432d21-099e-421d-a9c8-6f6467cded53 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1674 microversion: 2.1 time: 0.241075 Oct 13 04:24:58.302828 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 475/955] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:24:58 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1674 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:24:58.308215 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-dfe7edb4-9f7f-4bc6-8c30-b25ec35b26f4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:58.309157 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-dfe7edb4-9f7f-4bc6-8c30-b25ec35b26f4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:58.315005 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dfe7edb4-9f7f-4bc6-8c30-b25ec35b26f4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:58.315451 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dfe7edb4-9f7f-4bc6-8c30-b25ec35b26f4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:58.316213 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dfe7edb4-9f7f-4bc6-8c30-b25ec35b26f4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:58.316635 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dfe7edb4-9f7f-4bc6-8c30-b25ec35b26f4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:58.378877 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-dfe7edb4-9f7f-4bc6-8c30-b25ec35b26f4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 0.074166 Oct 13 04:24:58.379600 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 476/956] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:58 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:24:58.500219 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-78e2eb9f-4d08-4897-b4a2-983d096af56b tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "POST /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/action" status: 202 len: 0 microversion: 2.1 time: 0.533285 Oct 13 04:24:58.501433 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 481/957] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:24:57 2021] POST /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:24:58.511730 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-5fa9876f-3dc0-41b9-a890-882e57a9f782 req-f753362c-84d2-4418-8c1e-50179a45c059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e01f589-9c51-46fc-ba95-f16538ccba87", "tag": "0bd06624-1837-4923-9daf-aa14f17b4981"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:58.515324 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:24:58.515324 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:24:58.531210 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-5fa9876f-3dc0-41b9-a890-882e57a9f782 req-f753362c-84d2-4418-8c1e-50179a45c059 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:58.532227 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-5fa9876f-3dc0-41b9-a890-882e57a9f782 req-f753362c-84d2-4418-8c1e-50179a45c059 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:58.546980 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-5fa9876f-3dc0-41b9-a890-882e57a9f782 req-f753362c-84d2-4418-8c1e-50179a45c059 service nova] Creating event network-changed:0bd06624-1837-4923-9daf-aa14f17b4981 for instance 7e01f589-9c51-46fc-ba95-f16538ccba87 on hv-cinder-81275 Oct 13 04:24:58.555932 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-5fa9876f-3dc0-41b9-a890-882e57a9f782 req-f753362c-84d2-4418-8c1e-50179a45c059 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047829 Oct 13 04:24:58.557196 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 477/958] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:24:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:24:59.310267 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c783f05d-1845-41ba-9dd3-2a66a409043a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:59.311006 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c783f05d-1845-41ba-9dd3-2a66a409043a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:59.318111 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c783f05d-1845-41ba-9dd3-2a66a409043a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:59.318535 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c783f05d-1845-41ba-9dd3-2a66a409043a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:59.319556 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c783f05d-1845-41ba-9dd3-2a66a409043a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:59.319974 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c783f05d-1845-41ba-9dd3-2a66a409043a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:59.392654 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-cafba707-3b09-47a9-a982-dd36d1aa2ae7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:59.394548 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-cafba707-3b09-47a9-a982-dd36d1aa2ae7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:59.402169 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cafba707-3b09-47a9-a982-dd36d1aa2ae7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:59.403001 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cafba707-3b09-47a9-a982-dd36d1aa2ae7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:59.404054 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cafba707-3b09-47a9-a982-dd36d1aa2ae7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:59.405205 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cafba707-3b09-47a9-a982-dd36d1aa2ae7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:59.504982 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-cafba707-3b09-47a9-a982-dd36d1aa2ae7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 0.117178 Oct 13 04:24:59.505926 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 478/959] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:24:59 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:24:59.741441 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ba39a04b-2277-4d43-8817-5a1b392b9966 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:59.742085 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ba39a04b-2277-4d43-8817-5a1b392b9966 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:59.748921 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ba39a04b-2277-4d43-8817-5a1b392b9966 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:59.749769 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ba39a04b-2277-4d43-8817-5a1b392b9966 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:59.750648 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ba39a04b-2277-4d43-8817-5a1b392b9966 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:59.751265 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ba39a04b-2277-4d43-8817-5a1b392b9966 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:59.774941 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-c783f05d-1845-41ba-9dd3-2a66a409043a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:24:59.784700 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c783f05d-1845-41ba-9dd3-2a66a409043a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1674 microversion: 2.1 time: 0.478805 Oct 13 04:24:59.794966 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 482/960] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:24:59 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1674 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:24:59.859006 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-ba39a04b-2277-4d43-8817-5a1b392b9966 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lazy-loading 'services' on Instance uuid 7e01f589-9c51-46fc-ba95-f16538ccba87 {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:24:59.870031 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-4ff904ec-8cac-454d-84b1-67a42508a994 req-c4299603-d356-433c-b1c0-73b4cc444186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e01f589-9c51-46fc-ba95-f16538ccba87", "tag": "0bd06624-1837-4923-9daf-aa14f17b4981"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:24:59.871570 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:24:59.871570 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:24:59.882193 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-4ff904ec-8cac-454d-84b1-67a42508a994 req-c4299603-d356-433c-b1c0-73b4cc444186 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:59.883303 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-4ff904ec-8cac-454d-84b1-67a42508a994 req-c4299603-d356-433c-b1c0-73b4cc444186 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:59.897227 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-4ff904ec-8cac-454d-84b1-67a42508a994 req-c4299603-d356-433c-b1c0-73b4cc444186 service nova] Creating event network-changed:0bd06624-1837-4923-9daf-aa14f17b4981 for instance 7e01f589-9c51-46fc-ba95-f16538ccba87 on hv-cinder-81275 Oct 13 04:24:59.902717 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-4ff904ec-8cac-454d-84b1-67a42508a994 req-c4299603-d356-433c-b1c0-73b4cc444186 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106584 Oct 13 04:24:59.904056 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 483/961] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:24:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:24:59.956536 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ba39a04b-2277-4d43-8817-5a1b392b9966 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments/77641d26-0807-4902-a4fd-8c29c0d7b1d0" status: 202 len: 0 microversion: 2.1 time: 0.219519 Oct 13 04:24:59.957124 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 479/962] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Oct 13 04:24:59 2021] DELETE /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments/77641d26-0807-4902-a4fd-8c29c0d7b1d0 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:24:59.965865 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c3828f98-5532-4490-8ccd-a6892511a993 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:24:59.967555 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c3828f98-5532-4490-8ccd-a6892511a993 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:24:59.976336 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c3828f98-5532-4490-8ccd-a6892511a993 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:59.976963 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c3828f98-5532-4490-8ccd-a6892511a993 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:24:59.978511 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c3828f98-5532-4490-8ccd-a6892511a993 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:24:59.979134 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c3828f98-5532-4490-8ccd-a6892511a993 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:00.014008 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c3828f98-5532-4490-8ccd-a6892511a993 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052148 Oct 13 04:25:00.014574 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 484/963] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:24:59 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:25:00.524531 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-61ffedce-5afb-4043-8011-ffeab0504f67 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:00.526114 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-61ffedce-5afb-4043-8011-ffeab0504f67 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:00.535570 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-61ffedce-5afb-4043-8011-ffeab0504f67 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:00.536013 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-61ffedce-5afb-4043-8011-ffeab0504f67 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:00.536800 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-61ffedce-5afb-4043-8011-ffeab0504f67 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:00.537222 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-61ffedce-5afb-4043-8011-ffeab0504f67 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:00.667148 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-d3905a99-5498-4960-a200-8deefc6ea274 req-82f3b769-eae1-4662-b0e4-74ae669fa910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a527ca0-f4d9-4478-8737-56edd7fe83fc", "name": "network-vif-deleted", "tag": "2bf8b44d-dd7e-4a64-bef6-74e34e11e05f"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:00.668633 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:25:00.668633 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:25:00.675393 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-d3905a99-5498-4960-a200-8deefc6ea274 req-82f3b769-eae1-4662-b0e4-74ae669fa910 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:00.675828 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-d3905a99-5498-4960-a200-8deefc6ea274 req-82f3b769-eae1-4662-b0e4-74ae669fa910 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:00.686672 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-d3905a99-5498-4960-a200-8deefc6ea274 req-82f3b769-eae1-4662-b0e4-74ae669fa910 service nova] Creating event network-vif-deleted:2bf8b44d-dd7e-4a64-bef6-74e34e11e05f for instance 6a527ca0-f4d9-4478-8737-56edd7fe83fc on hv-cinder-81275 Oct 13 04:25:00.691626 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-d3905a99-5498-4960-a200-8deefc6ea274 req-82f3b769-eae1-4662-b0e4-74ae669fa910 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028092 Oct 13 04:25:00.692425 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 485/964] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:25:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:25:00.803474 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a03bdb07-4ecc-43fd-b9dd-2cbc8dceb6ba tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:00.804170 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a03bdb07-4ecc-43fd-b9dd-2cbc8dceb6ba tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:00.810706 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a03bdb07-4ecc-43fd-b9dd-2cbc8dceb6ba tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:00.811149 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a03bdb07-4ecc-43fd-b9dd-2cbc8dceb6ba tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:00.811960 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a03bdb07-4ecc-43fd-b9dd-2cbc8dceb6ba tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:00.812568 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a03bdb07-4ecc-43fd-b9dd-2cbc8dceb6ba tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:00.875647 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a03bdb07-4ecc-43fd-b9dd-2cbc8dceb6ba tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:00.882923 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a03bdb07-4ecc-43fd-b9dd-2cbc8dceb6ba tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1606 microversion: 2.1 time: 0.083889 Oct 13 04:25:00.883481 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 486/965] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:00 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1606 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:25:01.026164 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9caf0f5e-967c-4a0c-9537-b14219b334c2 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:01.027249 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9caf0f5e-967c-4a0c-9537-b14219b334c2 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:01.034413 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9caf0f5e-967c-4a0c-9537-b14219b334c2 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:01.034859 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9caf0f5e-967c-4a0c-9537-b14219b334c2 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:01.035635 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9caf0f5e-967c-4a0c-9537-b14219b334c2 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:01.036054 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9caf0f5e-967c-4a0c-9537-b14219b334c2 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:01.067802 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9caf0f5e-967c-4a0c-9537-b14219b334c2 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045462 Oct 13 04:25:01.068635 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 487/966] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:25:01 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:25:01.904225 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-92c2fda9-633f-46e4-92dd-90fa15fb55c6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:01.905799 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-92c2fda9-633f-46e4-92dd-90fa15fb55c6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:01.912317 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-92c2fda9-633f-46e4-92dd-90fa15fb55c6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:01.912760 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-92c2fda9-633f-46e4-92dd-90fa15fb55c6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:01.913514 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-92c2fda9-633f-46e4-92dd-90fa15fb55c6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:01.913973 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-92c2fda9-633f-46e4-92dd-90fa15fb55c6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:01.984153 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-92c2fda9-633f-46e4-92dd-90fa15fb55c6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:01.991860 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-92c2fda9-633f-46e4-92dd-90fa15fb55c6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1606 microversion: 2.1 time: 0.093879 Oct 13 04:25:01.992342 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 488/967] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:01 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1606 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:25:02.083057 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c11589c3-516a-44a4-b2a6-832abac1126d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:02.084492 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c11589c3-516a-44a4-b2a6-832abac1126d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:02.094032 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c11589c3-516a-44a4-b2a6-832abac1126d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:02.094470 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c11589c3-516a-44a4-b2a6-832abac1126d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:02.095231 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c11589c3-516a-44a4-b2a6-832abac1126d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:02.095654 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c11589c3-516a-44a4-b2a6-832abac1126d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:02.124215 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c11589c3-516a-44a4-b2a6-832abac1126d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047409 Oct 13 04:25:02.124761 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 489/968] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:25:02 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:25:03.012929 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-09c78f59-750a-459d-90ce-a1521b9a6625 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:03.014057 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-09c78f59-750a-459d-90ce-a1521b9a6625 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:03.021765 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-09c78f59-750a-459d-90ce-a1521b9a6625 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:03.022337 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-09c78f59-750a-459d-90ce-a1521b9a6625 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:03.023224 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-09c78f59-750a-459d-90ce-a1521b9a6625 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:03.023729 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-09c78f59-750a-459d-90ce-a1521b9a6625 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:03.088228 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-09c78f59-750a-459d-90ce-a1521b9a6625 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:03.095805 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-09c78f59-750a-459d-90ce-a1521b9a6625 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1322 microversion: 2.1 time: 0.089024 Oct 13 04:25:03.096366 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 490/969] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:03 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1322 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:03.135501 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-eddecb93-5b10-49dc-8d70-be43deaf79ab tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:03.136409 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-eddecb93-5b10-49dc-8d70-be43deaf79ab tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:03.142499 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-eddecb93-5b10-49dc-8d70-be43deaf79ab tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:03.142948 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-eddecb93-5b10-49dc-8d70-be43deaf79ab tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:03.143699 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-eddecb93-5b10-49dc-8d70-be43deaf79ab tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:03.144133 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-eddecb93-5b10-49dc-8d70-be43deaf79ab tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:03.173277 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-eddecb93-5b10-49dc-8d70-be43deaf79ab tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 Oct 13 04:25:03.173861 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 491/970] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:25:03 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:25:03.824470 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-61ffedce-5afb-4043-8011-ffeab0504f67 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 3.304135 Oct 13 04:25:03.826181 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 480/971] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:00 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 3312 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:04.112452 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b0f270ea-0585-4831-b9e9-9673982167e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:04.113079 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b0f270ea-0585-4831-b9e9-9673982167e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:04.119021 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0f270ea-0585-4831-b9e9-9673982167e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:04.119471 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0f270ea-0585-4831-b9e9-9673982167e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:04.120231 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0f270ea-0585-4831-b9e9-9673982167e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:04.120661 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0f270ea-0585-4831-b9e9-9673982167e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:04.150526 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0f270ea-0585-4831-b9e9-9673982167e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:04.150916 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0f270ea-0585-4831-b9e9-9673982167e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:04.151356 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.objects.instance [None req-b0f270ea-0585-4831-b9e9-9673982167e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lazy-loading 'fault' on Instance uuid 6a527ca0-f4d9-4478-8737-56edd7fe83fc {{(pid=108260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:25:04.185074 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2822bc77-eed6-45a0-b15a-4c7490ea169d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:04.186143 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2822bc77-eed6-45a0-b15a-4c7490ea169d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:04.193237 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b0f270ea-0585-4831-b9e9-9673982167e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:04.193436 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2822bc77-eed6-45a0-b15a-4c7490ea169d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:04.193740 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2822bc77-eed6-45a0-b15a-4c7490ea169d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:04.194563 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2822bc77-eed6-45a0-b15a-4c7490ea169d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:04.195158 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2822bc77-eed6-45a0-b15a-4c7490ea169d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:04.201926 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b0f270ea-0585-4831-b9e9-9673982167e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 200 len: 1327 microversion: 2.1 time: 0.093210 Oct 13 04:25:04.202523 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 492/972] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:04 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:25:04.233972 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2822bc77-eed6-45a0-b15a-4c7490ea169d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052937 Oct 13 04:25:04.234715 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 481/973] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:25:04 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:25:04.695515 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3a86ba94-cf32-414f-bcf9-ae515266a112 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1074509915", "imageRef": "4f468f34-171a-4b6e-a0cd-2e4c6fcda23d", "flavorRef": "452", "networks": [{"uuid": "a8bb1f41-1bb3-4e4f-857c-6817089c3add"}]}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:04.750091 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.network.neutron [None req-3a86ba94-cf32-414f-bcf9-ae515266a112 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] validate_networks() for [('a8bb1f41-1bb3-4e4f-857c-6817089c3add', None, None, None, None, None)] {{(pid=108260) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:25:04.837344 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e191eec9-72df-4b83-b6a4-19ddcd1eedc3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:04.838178 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e191eec9-72df-4b83-b6a4-19ddcd1eedc3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:04.844583 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e191eec9-72df-4b83-b6a4-19ddcd1eedc3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:04.845024 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e191eec9-72df-4b83-b6a4-19ddcd1eedc3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:04.845822 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e191eec9-72df-4b83-b6a4-19ddcd1eedc3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:04.846247 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e191eec9-72df-4b83-b6a4-19ddcd1eedc3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:04.906829 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e191eec9-72df-4b83-b6a4-19ddcd1eedc3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 0.073122 Oct 13 04:25:04.907509 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 482/974] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:04 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:05.119229 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-3a86ba94-cf32-414f-bcf9-ae515266a112 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Flavor limits 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:25:05.119727 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-3a86ba94-cf32-414f-bcf9-ae515266a112 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Image limits 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:25:05.120126 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-3a86ba94-cf32-414f-bcf9-ae515266a112 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Flavor pref 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:25:05.120527 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-3a86ba94-cf32-414f-bcf9-ae515266a112 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Image pref 0:0:0 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:25:05.120922 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.virt.hardware [None req-3a86ba94-cf32-414f-bcf9-ae515266a112 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:25:05.129945 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3a86ba94-cf32-414f-bcf9-ae515266a112 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:05.130386 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3a86ba94-cf32-414f-bcf9-ae515266a112 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:05.131154 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3a86ba94-cf32-414f-bcf9-ae515266a112 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:05.131583 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3a86ba94-cf32-414f-bcf9-ae515266a112 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:05.148550 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-3a86ba94-cf32-414f-bcf9-ae515266a112 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Getting quotas for project ad9e3664217546579b7f55d3081e6eb0. Resources: {'ram', 'cores', 'instances'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:25:05.152620 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.quota [None req-3a86ba94-cf32-414f-bcf9-ae515266a112 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Getting quotas for user 893b2d39d23f49688d9535132468af8f and project ad9e3664217546579b7f55d3081e6eb0. Resources: {'ram', 'cores', 'instances'} {{(pid=108260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:25:05.163908 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3a86ba94-cf32-414f-bcf9-ae515266a112 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Going to run 1 instances... {{(pid=108260) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:25:05.166215 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3a86ba94-cf32-414f-bcf9-ae515266a112 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f468f34-171a-4b6e-a0cd-2e4c6fcda23d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:25:05.212147 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3a86ba94-cf32-414f-bcf9-ae515266a112 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520247 Oct 13 04:25:05.213056 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 493/975] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Oct 13 04:25:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 04:25:05.220146 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-62c2a83a-a8cd-4743-a477-24a13bd4e825 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:05.220487 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-62c2a83a-a8cd-4743-a477-24a13bd4e825 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:05.222342 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-0831b67d-8fe1-4cfe-ab8d-cff1d36c3d02 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:05.222949 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-0831b67d-8fe1-4cfe-ab8d-cff1d36c3d02 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:05.227177 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62c2a83a-a8cd-4743-a477-24a13bd4e825 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:05.227622 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62c2a83a-a8cd-4743-a477-24a13bd4e825 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:05.239977 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62c2a83a-a8cd-4743-a477-24a13bd4e825 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:05.240637 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62c2a83a-a8cd-4743-a477-24a13bd4e825 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:05.255039 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-62c2a83a-a8cd-4743-a477-24a13bd4e825 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] HTTP exception thrown: Instance 6a527ca0-f4d9-4478-8737-56edd7fe83fc could not be found. Oct 13 04:25:05.255762 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-62c2a83a-a8cd-4743-a477-24a13bd4e825 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Returning 404 to user: Instance 6a527ca0-f4d9-4478-8737-56edd7fe83fc could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:25:05.256813 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-62c2a83a-a8cd-4743-a477-24a13bd4e825 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 404 len: 111 microversion: 2.1 time: 0.041156 Oct 13 04:25:05.260842 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 483/976] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:05 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:25:05.262451 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-37b67c0f-b8fe-454e-b393-ddaf28c561fd tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:05.263346 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-37b67c0f-b8fe-454e-b393-ddaf28c561fd tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:05.269342 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-37b67c0f-b8fe-454e-b393-ddaf28c561fd tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:05.269841 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-37b67c0f-b8fe-454e-b393-ddaf28c561fd tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:05.270607 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-37b67c0f-b8fe-454e-b393-ddaf28c561fd tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:05.271029 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-37b67c0f-b8fe-454e-b393-ddaf28c561fd tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:05.281852 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-0831b67d-8fe1-4cfe-ab8d-cff1d36c3d02 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:05.290396 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-0831b67d-8fe1-4cfe-ab8d-cff1d36c3d02 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124" status: 200 len: 1219 microversion: 2.1 time: 0.071587 Oct 13 04:25:05.291320 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 494/977] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:05 2021] GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:05.301311 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-37b67c0f-b8fe-454e-b393-ddaf28c561fd tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042690 Oct 13 04:25:05.302090 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 484/978] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:25:05 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:25:05.306512 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-45eb82e9-9cc9-41f6-b76c-85755fd72a06 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '.version_select at 0x7f33f6c2caf0>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:05.311677 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4bf9ff19-071b-4784-a1fe-955c912b1210 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:05.312169 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4bf9ff19-071b-4784-a1fe-955c912b1210 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:05.318467 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4bf9ff19-071b-4784-a1fe-955c912b1210 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:05.318904 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4bf9ff19-071b-4784-a1fe-955c912b1210 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:05.321801 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4bf9ff19-071b-4784-a1fe-955c912b1210 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:05.322281 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4bf9ff19-071b-4784-a1fe-955c912b1210 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:05.331367 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-45eb82e9-9cc9-41f6-b76c-85755fd72a06 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-266153083" status: 202 len: 0 microversion: 2.1 time: 0.027968 Oct 13 04:25:05.332636 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 495/979] 10.222.0.55 () {58 vars in 1217 bytes} [Wed Oct 13 04:25:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-266153083 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:05.413450 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-4bf9ff19-071b-4784-a1fe-955c912b1210 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] HTTP exception thrown: Instance 7e01f589-9c51-46fc-ba95-f16538ccba87 is not attached to volume 77641d26-0807-4902-a4fd-8c29c0d7b1d0 Oct 13 04:25:05.414171 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4bf9ff19-071b-4784-a1fe-955c912b1210 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Returning 404 to user: Instance 7e01f589-9c51-46fc-ba95-f16538ccba87 is not attached to volume 77641d26-0807-4902-a4fd-8c29c0d7b1d0 {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:25:05.415252 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4bf9ff19-071b-4784-a1fe-955c912b1210 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments/77641d26-0807-4902-a4fd-8c29c0d7b1d0" status: 404 len: 154 microversion: 2.1 time: 0.107376 Oct 13 04:25:05.417693 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 485/980] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Oct 13 04:25:05 2021] DELETE /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87/os-volume_attachments/77641d26-0807-4902-a4fd-8c29c0d7b1d0 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 04:25:05.919604 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-19df465a-318e-4c70-bea4-2cb7f6aaa808 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:05.920439 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-19df465a-318e-4c70-bea4-2cb7f6aaa808 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:05.927083 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-19df465a-318e-4c70-bea4-2cb7f6aaa808 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:05.927529 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-19df465a-318e-4c70-bea4-2cb7f6aaa808 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:05.928277 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-19df465a-318e-4c70-bea4-2cb7f6aaa808 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:05.929524 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-19df465a-318e-4c70-bea4-2cb7f6aaa808 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:05.999973 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-19df465a-318e-4c70-bea4-2cb7f6aaa808 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 0.084595 Oct 13 04:25:06.000916 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 496/981] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:05 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:06.060467 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f7a3aa33-6851-40b2-9b66-a66ab5f4a9d6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'create', calling method: .version_select at 0x7f33f6b309d0>, body: {"keypair": {"name": "tempest-keypair-1917577085"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:06.078897 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-f7a3aa33-6851-40b2-9b66-a66ab5f4a9d6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Getting quotas for project f2312bd342e040f1ade7109084831451. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:25:06.082748 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-f7a3aa33-6851-40b2-9b66-a66ab5f4a9d6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Getting quotas for user 9c76000ef3ee4d9eabd8de600a39badb and project f2312bd342e040f1ade7109084831451. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:25:06.163258 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-f7a3aa33-6851-40b2-9b66-a66ab5f4a9d6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Getting quotas for project f2312bd342e040f1ade7109084831451. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:25:06.167046 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-f7a3aa33-6851-40b2-9b66-a66ab5f4a9d6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Getting quotas for user 9c76000ef3ee4d9eabd8de600a39badb and project f2312bd342e040f1ade7109084831451. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:25:06.181265 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f7a3aa33-6851-40b2-9b66-a66ab5f4a9d6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.124338 Oct 13 04:25:06.186949 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 486/982] 10.222.0.55 () {60 vars in 1157 bytes} [Wed Oct 13 04:25:06 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:06.309432 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c1f7282d-bd3b-4564-800f-23f4a8ec67eb tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:06.310257 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c1f7282d-bd3b-4564-800f-23f4a8ec67eb tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:06.321478 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c1f7282d-bd3b-4564-800f-23f4a8ec67eb tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:06.322054 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c1f7282d-bd3b-4564-800f-23f4a8ec67eb tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:06.323422 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c1f7282d-bd3b-4564-800f-23f4a8ec67eb tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:06.324258 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c1f7282d-bd3b-4564-800f-23f4a8ec67eb tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:06.401903 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-c1f7282d-bd3b-4564-800f-23f4a8ec67eb tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:06.410099 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c1f7282d-bd3b-4564-800f-23f4a8ec67eb tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124" status: 200 len: 1277 microversion: 2.1 time: 0.105382 Oct 13 04:25:06.411762 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 497/983] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:06 2021] GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124 => generated 1277 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:06.590531 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c2b1bf54-badf-4ef9-bf05-0473bde17778 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:06.591171 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c2b1bf54-badf-4ef9-bf05-0473bde17778 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:06.598254 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2b1bf54-badf-4ef9-bf05-0473bde17778 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:06.598890 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2b1bf54-badf-4ef9-bf05-0473bde17778 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:06.599651 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2b1bf54-badf-4ef9-bf05-0473bde17778 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:06.600223 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2b1bf54-badf-4ef9-bf05-0473bde17778 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:06.625410 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c2b1bf54-badf-4ef9-bf05-0473bde17778 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Going to try to terminate instance {{(pid=108259) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:25:06.716003 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c2b1bf54-badf-4ef9-bf05-0473bde17778 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 204 len: 0 microversion: 2.1 time: 0.130029 Oct 13 04:25:06.716666 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 487/984] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:25:06 2021] DELETE /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 04:25:06.725743 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b5956872-96b7-416b-8cc1-e3236263aa5a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:06.726345 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b5956872-96b7-416b-8cc1-e3236263aa5a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:06.732581 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b5956872-96b7-416b-8cc1-e3236263aa5a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:06.733013 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b5956872-96b7-416b-8cc1-e3236263aa5a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:06.736376 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b5956872-96b7-416b-8cc1-e3236263aa5a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:06.736813 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b5956872-96b7-416b-8cc1-e3236263aa5a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:06.965138 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b5956872-96b7-416b-8cc1-e3236263aa5a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:06.980677 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b5956872-96b7-416b-8cc1-e3236263aa5a tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1555 microversion: 2.1 time: 0.259339 Oct 13 04:25:06.981645 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 498/985] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:06 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1555 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:07.012380 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e03ae529-9bf9-45a8-8dff-c01881b36297 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:07.013376 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e03ae529-9bf9-45a8-8dff-c01881b36297 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:07.019953 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e03ae529-9bf9-45a8-8dff-c01881b36297 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:07.020393 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e03ae529-9bf9-45a8-8dff-c01881b36297 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:07.021160 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e03ae529-9bf9-45a8-8dff-c01881b36297 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:07.021578 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e03ae529-9bf9-45a8-8dff-c01881b36297 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:07.178252 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e03ae529-9bf9-45a8-8dff-c01881b36297 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 0.169845 Oct 13 04:25:07.182595 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 488/986] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:07 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:07.428434 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-786edf1e-72bc-4825-afe6-f1218692add3 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:07.429592 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-786edf1e-72bc-4825-afe6-f1218692add3 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:07.436164 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-786edf1e-72bc-4825-afe6-f1218692add3 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:07.436976 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-786edf1e-72bc-4825-afe6-f1218692add3 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:07.437935 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-786edf1e-72bc-4825-afe6-f1218692add3 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:07.438511 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-786edf1e-72bc-4825-afe6-f1218692add3 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:07.509302 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-6e224863-b399-46f5-a887-86828eeda6d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-293192327", "imageRef": "4f468f34-171a-4b6e-a0cd-2e4c6fcda23d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58ed8cef-059d-4c9e-a8e2-6045b8f93ca6"}], "security_groups": [{"name": "tempest-securitygroup--1566798953"}], "key_name": "tempest-keypair-1917577085", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:07.653051 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-786edf1e-72bc-4825-afe6-f1218692add3 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:07.659288 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.network.neutron [None req-6e224863-b399-46f5-a887-86828eeda6d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] validate_networks() for [('58ed8cef-059d-4c9e-a8e2-6045b8f93ca6', None, None, None, None, None)] {{(pid=108259) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:25:07.661087 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-786edf1e-72bc-4825-afe6-f1218692add3 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124" status: 200 len: 1319 microversion: 2.1 time: 0.236192 Oct 13 04:25:07.661919 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 499/987] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:07 2021] GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:07.815790 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-02532c77-a014-4a79-a16a-e9d65d858b6b req-54b48e04-fc13-4c57-9144-2954e7a495a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "093c7eca-94da-41d6-b83c-8f20720c2124", "tag": "13e9a5b6-1fe7-42c6-84ed-1a4c1ef0bf3b"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:07.817757 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:25:07.817757 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:25:07.825938 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-02532c77-a014-4a79-a16a-e9d65d858b6b req-54b48e04-fc13-4c57-9144-2954e7a495a4 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:07.826362 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-02532c77-a014-4a79-a16a-e9d65d858b6b req-54b48e04-fc13-4c57-9144-2954e7a495a4 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:07.836827 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-02532c77-a014-4a79-a16a-e9d65d858b6b req-54b48e04-fc13-4c57-9144-2954e7a495a4 service nova] Creating event network-changed:13e9a5b6-1fe7-42c6-84ed-1a4c1ef0bf3b for instance 093c7eca-94da-41d6-b83c-8f20720c2124 on hv-cinder-81275 Oct 13 04:25:07.841771 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-02532c77-a014-4a79-a16a-e9d65d858b6b req-54b48e04-fc13-4c57-9144-2954e7a495a4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030239 Oct 13 04:25:07.843801 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 500/988] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:25:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:25:07.999414 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-916209f9-3caf-4580-9b8b-083a6f76117d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:08.000128 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-916209f9-3caf-4580-9b8b-083a6f76117d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:08.006691 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-916209f9-3caf-4580-9b8b-083a6f76117d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:08.007132 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-916209f9-3caf-4580-9b8b-083a6f76117d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:08.007888 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-916209f9-3caf-4580-9b8b-083a6f76117d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:08.008315 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-916209f9-3caf-4580-9b8b-083a6f76117d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:08.317431 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-916209f9-3caf-4580-9b8b-083a6f76117d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:08.325241 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-916209f9-3caf-4580-9b8b-083a6f76117d tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1555 microversion: 2.1 time: 0.329976 Oct 13 04:25:08.325840 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 501/989] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:07 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1555 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:08.339287 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d51a5535-7ad3-42ca-ae0f-d886ad35b7b8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:08.340193 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d51a5535-7ad3-42ca-ae0f-d886ad35b7b8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:08.340925 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-6e224863-b399-46f5-a887-86828eeda6d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Flavor limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:25:08.341412 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-6e224863-b399-46f5-a887-86828eeda6d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Image limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:25:08.341941 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-6e224863-b399-46f5-a887-86828eeda6d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Flavor pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:25:08.342351 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-6e224863-b399-46f5-a887-86828eeda6d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Image pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:25:08.342872 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-6e224863-b399-46f5-a887-86828eeda6d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:25:08.346157 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d51a5535-7ad3-42ca-ae0f-d886ad35b7b8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:08.346646 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d51a5535-7ad3-42ca-ae0f-d886ad35b7b8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:08.347343 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d51a5535-7ad3-42ca-ae0f-d886ad35b7b8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:08.347823 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d51a5535-7ad3-42ca-ae0f-d886ad35b7b8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:08.352458 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6e224863-b399-46f5-a887-86828eeda6d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:08.352894 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6e224863-b399-46f5-a887-86828eeda6d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:08.354337 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6e224863-b399-46f5-a887-86828eeda6d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:08.354781 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6e224863-b399-46f5-a887-86828eeda6d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:08.371299 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-6e224863-b399-46f5-a887-86828eeda6d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Getting quotas for project f2312bd342e040f1ade7109084831451. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:25:08.375638 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-6e224863-b399-46f5-a887-86828eeda6d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Getting quotas for user 9c76000ef3ee4d9eabd8de600a39badb and project f2312bd342e040f1ade7109084831451. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:25:08.387170 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-6e224863-b399-46f5-a887-86828eeda6d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Going to run 1 instances... {{(pid=108259) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:25:08.389699 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-6e224863-b399-46f5-a887-86828eeda6d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f468f34-171a-4b6e-a0cd-2e4c6fcda23d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:25:08.410846 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d51a5535-7ad3-42ca-ae0f-d886ad35b7b8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 0.074842 Oct 13 04:25:08.415122 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 502/990] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:08 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:08.436686 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-6e224863-b399-46f5-a887-86828eeda6d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.931754 Oct 13 04:25:08.437710 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 489/991] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Oct 13 04:25:07 2021] POST /compute/v2.1/servers => generated 402 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 04:25:08.449515 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-8539c4a4-fd3b-49bc-8a96-ab59dcb91014 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:08.450442 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-8539c4a4-fd3b-49bc-8a96-ab59dcb91014 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:08.507390 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-8539c4a4-fd3b-49bc-8a96-ab59dcb91014 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:08.517074 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-8539c4a4-fd3b-49bc-8a96-ab59dcb91014 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 200 len: 1237 microversion: 2.1 time: 0.071768 Oct 13 04:25:08.517918 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 503/992] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:08 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:08.678225 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0cd6ace7-e0dd-424e-a5de-469a77be278a tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:08.678831 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0cd6ace7-e0dd-424e-a5de-469a77be278a tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:08.685464 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0cd6ace7-e0dd-424e-a5de-469a77be278a tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:08.685934 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0cd6ace7-e0dd-424e-a5de-469a77be278a tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:08.686787 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0cd6ace7-e0dd-424e-a5de-469a77be278a tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:08.687541 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0cd6ace7-e0dd-424e-a5de-469a77be278a tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:09.174523 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-0cd6ace7-e0dd-424e-a5de-469a77be278a tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:09.183238 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0cd6ace7-e0dd-424e-a5de-469a77be278a tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124" status: 200 len: 1319 microversion: 2.1 time: 0.509186 Oct 13 04:25:09.183801 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 490/993] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:08 2021] GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124 => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:09.342684 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4a6a99bd-650c-4ec3-a5dc-bde888f1fdb4 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:09.343472 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4a6a99bd-650c-4ec3-a5dc-bde888f1fdb4 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:09.350090 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4a6a99bd-650c-4ec3-a5dc-bde888f1fdb4 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:09.350657 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4a6a99bd-650c-4ec3-a5dc-bde888f1fdb4 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:09.351502 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4a6a99bd-650c-4ec3-a5dc-bde888f1fdb4 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:09.352163 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4a6a99bd-650c-4ec3-a5dc-bde888f1fdb4 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:09.427457 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-dc346902-6a6a-4c17-a60f-7c2bc0e2613a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:09.428538 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-dc346902-6a6a-4c17-a60f-7c2bc0e2613a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:09.435333 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dc346902-6a6a-4c17-a60f-7c2bc0e2613a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:09.435774 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dc346902-6a6a-4c17-a60f-7c2bc0e2613a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:09.436654 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dc346902-6a6a-4c17-a60f-7c2bc0e2613a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:09.437271 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dc346902-6a6a-4c17-a60f-7c2bc0e2613a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:09.544031 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-dc346902-6a6a-4c17-a60f-7c2bc0e2613a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 0.120267 Oct 13 04:25:09.548505 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 491/994] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:09 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:09.550018 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-145f18cf-bf66-4ce6-a949-b171b835a95c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:09.550717 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-145f18cf-bf66-4ce6-a949-b171b835a95c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:09.557844 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-145f18cf-bf66-4ce6-a949-b171b835a95c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:09.557844 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-145f18cf-bf66-4ce6-a949-b171b835a95c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:09.559074 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-145f18cf-bf66-4ce6-a949-b171b835a95c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:09.559074 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-145f18cf-bf66-4ce6-a949-b171b835a95c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:09.659542 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-145f18cf-bf66-4ce6-a949-b171b835a95c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:09.667747 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-145f18cf-bf66-4ce6-a949-b171b835a95c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 200 len: 1295 microversion: 2.1 time: 0.121906 Oct 13 04:25:09.668500 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 492/995] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:09 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 1295 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:09.724858 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4a6a99bd-650c-4ec3-a5dc-bde888f1fdb4 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac5278aaad4f4294e2a7d971094fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41649d1bfdb049eeb3509c73dc1b039c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:09.732612 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4a6a99bd-650c-4ec3-a5dc-bde888f1fdb4 tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 200 len: 1555 microversion: 2.1 time: 0.393705 Oct 13 04:25:09.733236 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 504/996] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:09 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 1555 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:10.084014 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-f9a1147f-200a-43a7-ae27-dd49b2dfacd2 req-7e0c514a-f69a-4c03-935a-9b52b9d78341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e01f589-9c51-46fc-ba95-f16538ccba87", "name": "network-vif-deleted", "tag": "0bd06624-1837-4923-9daf-aa14f17b4981"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:10.085749 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:25:10.085749 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:25:10.093507 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-f9a1147f-200a-43a7-ae27-dd49b2dfacd2 req-7e0c514a-f69a-4c03-935a-9b52b9d78341 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:10.094633 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-f9a1147f-200a-43a7-ae27-dd49b2dfacd2 req-7e0c514a-f69a-4c03-935a-9b52b9d78341 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:10.106342 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-f9a1147f-200a-43a7-ae27-dd49b2dfacd2 req-7e0c514a-f69a-4c03-935a-9b52b9d78341 service nova] Creating event network-vif-deleted:0bd06624-1837-4923-9daf-aa14f17b4981 for instance 7e01f589-9c51-46fc-ba95-f16538ccba87 on hv-cinder-81275 Oct 13 04:25:10.112582 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-f9a1147f-200a-43a7-ae27-dd49b2dfacd2 req-7e0c514a-f69a-4c03-935a-9b52b9d78341 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032425 Oct 13 04:25:10.113455 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 493/997] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:25:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:25:10.201255 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3b84ef5d-9afb-4e16-baa2-b18d948d69f2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:10.202142 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3b84ef5d-9afb-4e16-baa2-b18d948d69f2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:10.209567 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3b84ef5d-9afb-4e16-baa2-b18d948d69f2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:10.210037 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3b84ef5d-9afb-4e16-baa2-b18d948d69f2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:10.210964 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3b84ef5d-9afb-4e16-baa2-b18d948d69f2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:10.211390 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3b84ef5d-9afb-4e16-baa2-b18d948d69f2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:10.389194 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-3b84ef5d-9afb-4e16-baa2-b18d948d69f2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:10.398443 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3b84ef5d-9afb-4e16-baa2-b18d948d69f2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124" status: 200 len: 1319 microversion: 2.1 time: 0.201694 Oct 13 04:25:10.400248 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 505/998] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:10 2021] GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:10.558238 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-fa470143-040f-4610-bfbe-01b947b615fd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:10.559139 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-fa470143-040f-4610-bfbe-01b947b615fd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:10.568649 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fa470143-040f-4610-bfbe-01b947b615fd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:10.569373 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fa470143-040f-4610-bfbe-01b947b615fd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:10.570564 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fa470143-040f-4610-bfbe-01b947b615fd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:10.570998 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fa470143-040f-4610-bfbe-01b947b615fd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:10.636782 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-fa470143-040f-4610-bfbe-01b947b615fd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 0.083716 Oct 13 04:25:10.638425 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 494/999] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:10 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:10.684137 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-88253106-a788-488d-bcc2-35b1d6ae62af tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:10.684745 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-88253106-a788-488d-bcc2-35b1d6ae62af tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:10.694919 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-88253106-a788-488d-bcc2-35b1d6ae62af tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:10.695354 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-88253106-a788-488d-bcc2-35b1d6ae62af tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:10.696198 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-88253106-a788-488d-bcc2-35b1d6ae62af tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:10.696642 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-88253106-a788-488d-bcc2-35b1d6ae62af tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:10.756693 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ae6a09e2-2653-4939-88df-81edf814a02e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:10.757307 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ae6a09e2-2653-4939-88df-81edf814a02e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] [instance: 7e01f589-9c51-46fc-ba95-f16538ccba87] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:10.770430 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ae6a09e2-2653-4939-88df-81edf814a02e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:10.771190 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ae6a09e2-2653-4939-88df-81edf814a02e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:10.773308 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ae6a09e2-2653-4939-88df-81edf814a02e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:10.774656 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ae6a09e2-2653-4939-88df-81edf814a02e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:10.793049 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-ae6a09e2-2653-4939-88df-81edf814a02e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] HTTP exception thrown: Instance 7e01f589-9c51-46fc-ba95-f16538ccba87 could not be found. Oct 13 04:25:10.794017 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ae6a09e2-2653-4939-88df-81edf814a02e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Returning 404 to user: Instance 7e01f589-9c51-46fc-ba95-f16538ccba87 could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:25:10.795110 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ae6a09e2-2653-4939-88df-81edf814a02e tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87" status: 404 len: 111 microversion: 2.1 time: 0.046689 Oct 13 04:25:10.795807 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 495/1000] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:10 2021] GET /compute/v2.1/servers/7e01f589-9c51-46fc-ba95-f16538ccba87 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 04:25:10.803967 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b6b33d76-64f2-4545-a3b6-03eedf2e732c tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] Calling method '.version_select at 0x7f33f6c871f0>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:10.830083 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b6b33d76-64f2-4545-a3b6-03eedf2e732c tempest-TestMinimumBasicScenario-1688613394 tempest-TestMinimumBasicScenario-1688613394-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-327218553" status: 202 len: 0 microversion: 2.1 time: 0.029702 Oct 13 04:25:10.831163 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 496/1001] 10.222.0.55 () {58 vars in 1268 bytes} [Wed Oct 13 04:25:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-327218553 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:10.963528 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-88253106-a788-488d-bcc2-35b1d6ae62af tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:10.972080 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-88253106-a788-488d-bcc2-35b1d6ae62af tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 200 len: 1363 microversion: 2.1 time: 0.291509 Oct 13 04:25:10.972845 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 506/1002] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:10 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:11.416489 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-eb8c57e7-dca7-484f-ba12-81efda8767fd tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:11.417798 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-eb8c57e7-dca7-484f-ba12-81efda8767fd tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:11.424621 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-eb8c57e7-dca7-484f-ba12-81efda8767fd tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:11.425302 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-eb8c57e7-dca7-484f-ba12-81efda8767fd tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:11.426296 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-eb8c57e7-dca7-484f-ba12-81efda8767fd tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:11.426879 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-eb8c57e7-dca7-484f-ba12-81efda8767fd tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:11.618786 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-eb8c57e7-dca7-484f-ba12-81efda8767fd tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:11.626768 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-eb8c57e7-dca7-484f-ba12-81efda8767fd tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124" status: 200 len: 1319 microversion: 2.1 time: 0.214102 Oct 13 04:25:11.627446 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 497/1003] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:11 2021] GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:11.648417 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-37683a5d-f713-48de-bb6e-65a197f9d6a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:11.649571 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-37683a5d-f713-48de-bb6e-65a197f9d6a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:11.656551 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-37683a5d-f713-48de-bb6e-65a197f9d6a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:11.657117 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-37683a5d-f713-48de-bb6e-65a197f9d6a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:11.658051 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-37683a5d-f713-48de-bb6e-65a197f9d6a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:11.658604 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-37683a5d-f713-48de-bb6e-65a197f9d6a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:11.721095 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-37683a5d-f713-48de-bb6e-65a197f9d6a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 0.076228 Oct 13 04:25:11.724951 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 507/1004] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:11 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:11.989787 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2d33cfd9-ab97-40b3-ae95-3ae1f82bbe11 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:11.990214 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2d33cfd9-ab97-40b3-ae95-3ae1f82bbe11 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:11.996466 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2d33cfd9-ab97-40b3-ae95-3ae1f82bbe11 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:11.996915 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2d33cfd9-ab97-40b3-ae95-3ae1f82bbe11 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:11.997744 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2d33cfd9-ab97-40b3-ae95-3ae1f82bbe11 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:11.998169 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2d33cfd9-ab97-40b3-ae95-3ae1f82bbe11 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:12.119920 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2d33cfd9-ab97-40b3-ae95-3ae1f82bbe11 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:12.127630 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2d33cfd9-ab97-40b3-ae95-3ae1f82bbe11 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 200 len: 1363 microversion: 2.1 time: 0.141703 Oct 13 04:25:12.128183 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 498/1005] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:11 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:12.136707 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-b8b0cfc1-4d0c-459a-a0d1-6169de0e8ef1 req-b9787c3e-5ec1-4bba-bed9-082034eb5f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8300b425-7073-4360-8038-343600de405f", "tag": "df66c66a-642c-4bce-9c38-ff454176b333"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:12.136707 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:25:12.136707 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:25:12.137394 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-b8b0cfc1-4d0c-459a-a0d1-6169de0e8ef1 req-b9787c3e-5ec1-4bba-bed9-082034eb5f80 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:12.137862 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-b8b0cfc1-4d0c-459a-a0d1-6169de0e8ef1 req-b9787c3e-5ec1-4bba-bed9-082034eb5f80 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:12.148611 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-b8b0cfc1-4d0c-459a-a0d1-6169de0e8ef1 req-b9787c3e-5ec1-4bba-bed9-082034eb5f80 service nova] Creating event network-changed:df66c66a-642c-4bce-9c38-ff454176b333 for instance 8300b425-7073-4360-8038-343600de405f on hv-cinder-81275 Oct 13 04:25:12.153511 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-b8b0cfc1-4d0c-459a-a0d1-6169de0e8ef1 req-b9787c3e-5ec1-4bba-bed9-082034eb5f80 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029114 Oct 13 04:25:12.154683 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 508/1006] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:25:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:25:12.644139 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ee87afa7-0f14-4943-8552-73ac28e3b6c2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:12.644703 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ee87afa7-0f14-4943-8552-73ac28e3b6c2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:12.656073 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ee87afa7-0f14-4943-8552-73ac28e3b6c2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:12.657395 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ee87afa7-0f14-4943-8552-73ac28e3b6c2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:12.658634 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ee87afa7-0f14-4943-8552-73ac28e3b6c2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:12.659645 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ee87afa7-0f14-4943-8552-73ac28e3b6c2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:12.733153 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e7c698af-82d5-430e-a310-93a0f327a5a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:12.734332 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e7c698af-82d5-430e-a310-93a0f327a5a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:12.741559 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e7c698af-82d5-430e-a310-93a0f327a5a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:12.742026 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e7c698af-82d5-430e-a310-93a0f327a5a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:12.742826 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e7c698af-82d5-430e-a310-93a0f327a5a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:12.743248 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e7c698af-82d5-430e-a310-93a0f327a5a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:12.803942 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ee87afa7-0f14-4943-8552-73ac28e3b6c2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:12.805361 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e7c698af-82d5-430e-a310-93a0f327a5a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 0.076314 Oct 13 04:25:12.806384 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 509/1007] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:12 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:12.811873 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ee87afa7-0f14-4943-8552-73ac28e3b6c2 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124" status: 200 len: 1319 microversion: 2.1 time: 0.171454 Oct 13 04:25:12.812434 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 499/1008] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:12 2021] GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:13.144705 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-afc83076-2669-4646-b404-bfab8e5e42a4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:13.145508 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-afc83076-2669-4646-b404-bfab8e5e42a4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:13.151983 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-afc83076-2669-4646-b404-bfab8e5e42a4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:13.152428 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-afc83076-2669-4646-b404-bfab8e5e42a4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:13.153184 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-afc83076-2669-4646-b404-bfab8e5e42a4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:13.153627 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-afc83076-2669-4646-b404-bfab8e5e42a4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:13.310777 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-afc83076-2669-4646-b404-bfab8e5e42a4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:13.318393 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-afc83076-2669-4646-b404-bfab8e5e42a4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 200 len: 1363 microversion: 2.1 time: 0.177675 Oct 13 04:25:13.325649 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 510/1009] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:13 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:13.817573 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f3760031-29c7-409d-b3be-627bacc5036c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:13.818453 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f3760031-29c7-409d-b3be-627bacc5036c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:13.826263 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3760031-29c7-409d-b3be-627bacc5036c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:13.826729 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3760031-29c7-409d-b3be-627bacc5036c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:13.827632 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3760031-29c7-409d-b3be-627bacc5036c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:13.828058 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f3760031-29c7-409d-b3be-627bacc5036c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:13.828221 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2f56fe84-2416-49fc-a82d-cc04a165a596 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:13.829028 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-2f56fe84-2416-49fc-a82d-cc04a165a596 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:13.836045 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2f56fe84-2416-49fc-a82d-cc04a165a596 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:13.836487 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2f56fe84-2416-49fc-a82d-cc04a165a596 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:13.837246 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2f56fe84-2416-49fc-a82d-cc04a165a596 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:13.837772 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2f56fe84-2416-49fc-a82d-cc04a165a596 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:13.892451 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f3760031-29c7-409d-b3be-627bacc5036c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 0.078454 Oct 13 04:25:13.893272 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 500/1010] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:13 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:13.969172 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-2f56fe84-2416-49fc-a82d-cc04a165a596 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:13.977166 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-2f56fe84-2416-49fc-a82d-cc04a165a596 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124" status: 200 len: 1319 microversion: 2.1 time: 0.152483 Oct 13 04:25:13.978269 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 511/1011] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:13 2021] GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:25:14.337844 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1b939208-2d93-40ed-b0a0-993d0b435f32 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:14.338646 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1b939208-2d93-40ed-b0a0-993d0b435f32 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:14.345335 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1b939208-2d93-40ed-b0a0-993d0b435f32 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:14.345889 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1b939208-2d93-40ed-b0a0-993d0b435f32 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:14.346764 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1b939208-2d93-40ed-b0a0-993d0b435f32 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:14.347737 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1b939208-2d93-40ed-b0a0-993d0b435f32 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:14.503026 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1b939208-2d93-40ed-b0a0-993d0b435f32 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:14.511049 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1b939208-2d93-40ed-b0a0-993d0b435f32 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 200 len: 1363 microversion: 2.1 time: 0.178298 Oct 13 04:25:14.512184 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 501/1012] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:14 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:14.626361 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-a9bdb708-905d-4a60-b41c-6d4140dabcfc req-cfa1ce31-3307-46d9-b30d-50f6baf3e050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "093c7eca-94da-41d6-b83c-8f20720c2124", "name": "network-vif-plugged", "status": "completed", "tag": "13e9a5b6-1fe7-42c6-84ed-1a4c1ef0bf3b"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:14.628278 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:25:14.628278 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:25:14.636679 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-a9bdb708-905d-4a60-b41c-6d4140dabcfc req-cfa1ce31-3307-46d9-b30d-50f6baf3e050 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:14.637136 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-a9bdb708-905d-4a60-b41c-6d4140dabcfc req-cfa1ce31-3307-46d9-b30d-50f6baf3e050 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:14.652025 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-a9bdb708-905d-4a60-b41c-6d4140dabcfc req-cfa1ce31-3307-46d9-b30d-50f6baf3e050 service nova] Creating event network-vif-plugged:13e9a5b6-1fe7-42c6-84ed-1a4c1ef0bf3b for instance 093c7eca-94da-41d6-b83c-8f20720c2124 on hv-cinder-81275 Oct 13 04:25:14.662226 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-a9bdb708-905d-4a60-b41c-6d4140dabcfc req-cfa1ce31-3307-46d9-b30d-50f6baf3e050 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044114 Oct 13 04:25:14.664871 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 512/1013] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:25:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:25:14.908131 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-515e9d9f-dd9c-4365-869b-0c9dcc40a089 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:14.908978 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-515e9d9f-dd9c-4365-869b-0c9dcc40a089 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:14.917039 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-515e9d9f-dd9c-4365-869b-0c9dcc40a089 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:14.917561 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-515e9d9f-dd9c-4365-869b-0c9dcc40a089 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:14.918491 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-515e9d9f-dd9c-4365-869b-0c9dcc40a089 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:14.919067 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-515e9d9f-dd9c-4365-869b-0c9dcc40a089 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:14.994600 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-227746fc-c22c-45ad-9eb1-8c848952e49f tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:14.995367 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-227746fc-c22c-45ad-9eb1-8c848952e49f tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:15.002199 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-227746fc-c22c-45ad-9eb1-8c848952e49f tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:15.002742 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-227746fc-c22c-45ad-9eb1-8c848952e49f tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:15.003575 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-227746fc-c22c-45ad-9eb1-8c848952e49f tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:15.004068 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-227746fc-c22c-45ad-9eb1-8c848952e49f tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:15.124891 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-227746fc-c22c-45ad-9eb1-8c848952e49f tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:15.132506 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-227746fc-c22c-45ad-9eb1-8c848952e49f tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124" status: 200 len: 1319 microversion: 2.1 time: 0.142070 Oct 13 04:25:15.133159 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 513/1014] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:14 2021] GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124 => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:15.234613 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-515e9d9f-dd9c-4365-869b-0c9dcc40a089 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 0.333291 Oct 13 04:25:15.235105 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 502/1015] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:14 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:15.528123 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7a662483-4408-47db-95d9-b47ceabf800f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:15.528749 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7a662483-4408-47db-95d9-b47ceabf800f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:15.535506 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7a662483-4408-47db-95d9-b47ceabf800f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:15.535948 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7a662483-4408-47db-95d9-b47ceabf800f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:15.536724 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7a662483-4408-47db-95d9-b47ceabf800f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:15.537141 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7a662483-4408-47db-95d9-b47ceabf800f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:15.661732 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-7a662483-4408-47db-95d9-b47ceabf800f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:15.670658 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7a662483-4408-47db-95d9-b47ceabf800f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 200 len: 1363 microversion: 2.1 time: 0.146054 Oct 13 04:25:15.671336 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 514/1016] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:15 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:16.149747 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d96eabad-3596-40cc-bb65-7ea5e794b4a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:16.150366 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d96eabad-3596-40cc-bb65-7ea5e794b4a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:16.157936 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d96eabad-3596-40cc-bb65-7ea5e794b4a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:16.158384 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d96eabad-3596-40cc-bb65-7ea5e794b4a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:16.159205 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d96eabad-3596-40cc-bb65-7ea5e794b4a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:16.159636 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d96eabad-3596-40cc-bb65-7ea5e794b4a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:16.247224 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a1874a3b-08ac-417f-bc38-d57c92392100 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:16.248606 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a1874a3b-08ac-417f-bc38-d57c92392100 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:16.254879 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a1874a3b-08ac-417f-bc38-d57c92392100 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:16.255457 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a1874a3b-08ac-417f-bc38-d57c92392100 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:16.256235 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a1874a3b-08ac-417f-bc38-d57c92392100 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:16.256662 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a1874a3b-08ac-417f-bc38-d57c92392100 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:16.290386 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-d96eabad-3596-40cc-bb65-7ea5e794b4a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:16.297641 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d96eabad-3596-40cc-bb65-7ea5e794b4a8 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124" status: 200 len: 1319 microversion: 2.1 time: 0.152195 Oct 13 04:25:16.298231 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 503/1017] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:16 2021] GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:16.326570 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a1874a3b-08ac-417f-bc38-d57c92392100 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 0.083534 Oct 13 04:25:16.328147 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 515/1018] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:16 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:25:16.687907 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d3c2700e-faa2-422a-90d6-8766f4381dbc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:16.688537 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d3c2700e-faa2-422a-90d6-8766f4381dbc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:16.694738 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d3c2700e-faa2-422a-90d6-8766f4381dbc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:16.695518 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d3c2700e-faa2-422a-90d6-8766f4381dbc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:16.696097 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d3c2700e-faa2-422a-90d6-8766f4381dbc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:16.696596 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d3c2700e-faa2-422a-90d6-8766f4381dbc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:16.819764 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-d3c2700e-faa2-422a-90d6-8766f4381dbc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:16.827563 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d3c2700e-faa2-422a-90d6-8766f4381dbc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 200 len: 1363 microversion: 2.1 time: 0.143528 Oct 13 04:25:16.828255 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 504/1019] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:16 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:17.316291 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f3032c08-9a38-406b-ac8d-91ad25003edf tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:17.316877 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f3032c08-9a38-406b-ac8d-91ad25003edf tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:17.323659 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f3032c08-9a38-406b-ac8d-91ad25003edf tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:17.324100 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f3032c08-9a38-406b-ac8d-91ad25003edf tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:17.324868 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f3032c08-9a38-406b-ac8d-91ad25003edf tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:17.326531 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f3032c08-9a38-406b-ac8d-91ad25003edf tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:17.342885 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c17a8647-65f2-462e-94df-8c462e256e8d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:17.343320 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c17a8647-65f2-462e-94df-8c462e256e8d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:17.357178 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c17a8647-65f2-462e-94df-8c462e256e8d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:17.357946 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c17a8647-65f2-462e-94df-8c462e256e8d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:17.358832 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c17a8647-65f2-462e-94df-8c462e256e8d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:17.359355 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c17a8647-65f2-462e-94df-8c462e256e8d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:17.472546 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c17a8647-65f2-462e-94df-8c462e256e8d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 0.133703 Oct 13 04:25:17.477974 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 505/1020] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:17 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:17.485886 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f3032c08-9a38-406b-ac8d-91ad25003edf tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:17.503462 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f3032c08-9a38-406b-ac8d-91ad25003edf tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124" status: 200 len: 1508 microversion: 2.1 time: 0.191121 Oct 13 04:25:17.511895 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 516/1021] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:17 2021] GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124 => generated 1508 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:17.521243 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-082cbff8-12db-40f1-bdc1-3ba10618e724 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "931e832b-d0bb-4cbd-95cb-a579fe03ff45", "device": "/dev/sdb"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:17.522926 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-082cbff8-12db-40f1-bdc1-3ba10618e724 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:17.529570 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-082cbff8-12db-40f1-bdc1-3ba10618e724 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:17.530039 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-082cbff8-12db-40f1-bdc1-3ba10618e724 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:17.530829 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-082cbff8-12db-40f1-bdc1-3ba10618e724 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:17.531436 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-082cbff8-12db-40f1-bdc1-3ba10618e724 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:17.797657 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-082cbff8-12db-40f1-bdc1-3ba10618e724 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "POST /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279683 Oct 13 04:25:17.798859 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 506/1022] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Oct 13 04:25:17 2021] POST /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:25:17.844191 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4b968803-e5eb-4ce3-9ca1-619ab9ba89d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:17.844796 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4b968803-e5eb-4ce3-9ca1-619ab9ba89d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:17.863579 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4b968803-e5eb-4ce3-9ca1-619ab9ba89d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:17.864029 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4b968803-e5eb-4ce3-9ca1-619ab9ba89d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:17.865114 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4b968803-e5eb-4ce3-9ca1-619ab9ba89d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:17.865543 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4b968803-e5eb-4ce3-9ca1-619ab9ba89d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:18.036470 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4b968803-e5eb-4ce3-9ca1-619ab9ba89d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:18.046240 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4b968803-e5eb-4ce3-9ca1-619ab9ba89d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 200 len: 1363 microversion: 2.1 time: 0.205798 Oct 13 04:25:18.048067 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 517/1023] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:17 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:18.485226 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4828ecf6-ded1-414a-a777-9cfd71aa0b2f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:18.486615 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4828ecf6-ded1-414a-a777-9cfd71aa0b2f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:18.493327 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4828ecf6-ded1-414a-a777-9cfd71aa0b2f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:18.493911 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4828ecf6-ded1-414a-a777-9cfd71aa0b2f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:18.494743 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4828ecf6-ded1-414a-a777-9cfd71aa0b2f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:18.495305 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4828ecf6-ded1-414a-a777-9cfd71aa0b2f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:18.533293 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-02408dd5-4709-401a-afe7-235dca9479c1 req-7d68df03-1181-4849-bb88-25b1550de174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8300b425-7073-4360-8038-343600de405f", "name": "network-vif-plugged", "status": "completed", "tag": "df66c66a-642c-4bce-9c38-ff454176b333"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:18.535514 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:25:18.535514 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:25:18.543206 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-02408dd5-4709-401a-afe7-235dca9479c1 req-7d68df03-1181-4849-bb88-25b1550de174 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:18.548611 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-02408dd5-4709-401a-afe7-235dca9479c1 req-7d68df03-1181-4849-bb88-25b1550de174 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:18.562317 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-02408dd5-4709-401a-afe7-235dca9479c1 req-7d68df03-1181-4849-bb88-25b1550de174 service nova] Creating event network-vif-plugged:df66c66a-642c-4bce-9c38-ff454176b333 for instance 8300b425-7073-4360-8038-343600de405f on hv-cinder-81275 Oct 13 04:25:18.563503 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4828ecf6-ded1-414a-a777-9cfd71aa0b2f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28161 microversion: 2.20 time: 0.082559 Oct 13 04:25:18.566216 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 507/1024] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:18 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28161 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:18.568019 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-02408dd5-4709-401a-afe7-235dca9479c1 req-7d68df03-1181-4849-bb88-25b1550de174 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039008 Oct 13 04:25:18.569242 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 518/1025] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:25:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:25:19.065210 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5d1a7fa4-0bc4-4880-a242-dcf7173356b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:19.065944 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-5d1a7fa4-0bc4-4880-a242-dcf7173356b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:19.072461 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5d1a7fa4-0bc4-4880-a242-dcf7173356b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:19.072930 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5d1a7fa4-0bc4-4880-a242-dcf7173356b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:19.073745 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5d1a7fa4-0bc4-4880-a242-dcf7173356b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:19.074172 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5d1a7fa4-0bc4-4880-a242-dcf7173356b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:19.195774 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-5d1a7fa4-0bc4-4880-a242-dcf7173356b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:19.210454 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-5d1a7fa4-0bc4-4880-a242-dcf7173356b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 200 len: 1363 microversion: 2.1 time: 0.149257 Oct 13 04:25:19.211053 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 508/1026] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:19 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:19.576914 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-376098b4-71bb-4c3f-8654-66511d0bb667 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:19.577892 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-376098b4-71bb-4c3f-8654-66511d0bb667 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:19.584388 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-376098b4-71bb-4c3f-8654-66511d0bb667 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:19.584882 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-376098b4-71bb-4c3f-8654-66511d0bb667 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:19.585856 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-376098b4-71bb-4c3f-8654-66511d0bb667 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:19.586376 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-376098b4-71bb-4c3f-8654-66511d0bb667 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:19.713761 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-376098b4-71bb-4c3f-8654-66511d0bb667 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28451 microversion: 2.20 time: 0.140867 Oct 13 04:25:19.714519 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 519/1027] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:19 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28451 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:20.227803 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e39e8733-3c2a-4a8f-8554-9b926f5ca4e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:20.228532 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e39e8733-3c2a-4a8f-8554-9b926f5ca4e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:20.235832 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e39e8733-3c2a-4a8f-8554-9b926f5ca4e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:20.236487 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e39e8733-3c2a-4a8f-8554-9b926f5ca4e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:20.237960 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e39e8733-3c2a-4a8f-8554-9b926f5ca4e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:20.238590 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e39e8733-3c2a-4a8f-8554-9b926f5ca4e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:20.726458 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b02b9b51-788d-4b63-b5bd-78b8b850d37f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:20.727630 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b02b9b51-788d-4b63-b5bd-78b8b850d37f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:20.734456 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b02b9b51-788d-4b63-b5bd-78b8b850d37f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:20.735012 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b02b9b51-788d-4b63-b5bd-78b8b850d37f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:20.736038 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b02b9b51-788d-4b63-b5bd-78b8b850d37f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:20.736557 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b02b9b51-788d-4b63-b5bd-78b8b850d37f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:20.780704 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-e39e8733-3c2a-4a8f-8554-9b926f5ca4e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:20.788764 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e39e8733-3c2a-4a8f-8554-9b926f5ca4e4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 200 len: 1550 microversion: 2.1 time: 0.564857 Oct 13 04:25:20.789580 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 509/1028] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:20 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 1550 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:20.807508 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b02b9b51-788d-4b63-b5bd-78b8b850d37f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28451 microversion: 2.20 time: 0.085320 Oct 13 04:25:20.808162 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 520/1029] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:20 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28451 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:20.810416 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-158a771f-0d1f-456d-b288-13d627c0af36 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:20.811738 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-158a771f-0d1f-456d-b288-13d627c0af36 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:20.819883 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-158a771f-0d1f-456d-b288-13d627c0af36 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:20.820423 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-158a771f-0d1f-456d-b288-13d627c0af36 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:20.821432 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-158a771f-0d1f-456d-b288-13d627c0af36 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:20.821959 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-158a771f-0d1f-456d-b288-13d627c0af36 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:20.933278 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-158a771f-0d1f-456d-b288-13d627c0af36 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131777 Oct 13 04:25:20.934248 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 510/1030] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Oct 13 04:25:20 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:25:21.819967 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-63252bca-f18e-4a63-ae58-a98037fdf0b2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:21.821098 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-63252bca-f18e-4a63-ae58-a98037fdf0b2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:21.829705 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-63252bca-f18e-4a63-ae58-a98037fdf0b2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:21.830266 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-63252bca-f18e-4a63-ae58-a98037fdf0b2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:21.831102 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-63252bca-f18e-4a63-ae58-a98037fdf0b2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:21.831568 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-63252bca-f18e-4a63-ae58-a98037fdf0b2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:21.924994 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-63252bca-f18e-4a63-ae58-a98037fdf0b2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.109075 Oct 13 04:25:21.925816 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 521/1031] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:21 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:22.787723 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-8cc686f2-eb23-44c1-91a2-9b8ef7c2c51d req-69b7e018-5700-41d6-b193-77d371b0f499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8300b425-7073-4360-8038-343600de405f", "tag": "df66c66a-642c-4bce-9c38-ff454176b333"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:22.789959 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5e186754-4ed4-4ec7-a0ce-893d99e79d22 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:22.793325 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-5e186754-4ed4-4ec7-a0ce-893d99e79d22 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:22.793630 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:25:22.793630 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:25:22.804706 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5e186754-4ed4-4ec7-a0ce-893d99e79d22 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:22.807031 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-8cc686f2-eb23-44c1-91a2-9b8ef7c2c51d req-69b7e018-5700-41d6-b193-77d371b0f499 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:22.807510 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5e186754-4ed4-4ec7-a0ce-893d99e79d22 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:22.808350 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5e186754-4ed4-4ec7-a0ce-893d99e79d22 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:22.808892 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5e186754-4ed4-4ec7-a0ce-893d99e79d22 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:22.811791 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-8cc686f2-eb23-44c1-91a2-9b8ef7c2c51d req-69b7e018-5700-41d6-b193-77d371b0f499 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:22.833396 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-8cc686f2-eb23-44c1-91a2-9b8ef7c2c51d req-69b7e018-5700-41d6-b193-77d371b0f499 service nova] Creating event network-changed:df66c66a-642c-4bce-9c38-ff454176b333 for instance 8300b425-7073-4360-8038-343600de405f on hv-cinder-81275 Oct 13 04:25:22.839079 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-8cc686f2-eb23-44c1-91a2-9b8ef7c2c51d req-69b7e018-5700-41d6-b193-77d371b0f499 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055275 Oct 13 04:25:22.841428 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 522/1032] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:25:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:25:22.886956 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-5e186754-4ed4-4ec7-a0ce-893d99e79d22 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 14 microversion: 2.1 time: 0.107549 Oct 13 04:25:22.887780 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 511/1033] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:22 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 04:25:22.937137 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-48fef434-7e5f-41f8-82bb-1563b82f5f0c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:22.938179 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-48fef434-7e5f-41f8-82bb-1563b82f5f0c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:22.944371 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-48fef434-7e5f-41f8-82bb-1563b82f5f0c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:22.944811 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-48fef434-7e5f-41f8-82bb-1563b82f5f0c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:22.945573 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-48fef434-7e5f-41f8-82bb-1563b82f5f0c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:22.946017 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-48fef434-7e5f-41f8-82bb-1563b82f5f0c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:23.010135 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-48fef434-7e5f-41f8-82bb-1563b82f5f0c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.077028 Oct 13 04:25:23.011321 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 523/1034] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:22 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:23.900841 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1393a48e-97d3-4b73-a004-602e46363072 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:23.903084 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1393a48e-97d3-4b73-a004-602e46363072 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:23.913825 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1393a48e-97d3-4b73-a004-602e46363072 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:23.914567 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1393a48e-97d3-4b73-a004-602e46363072 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:23.915608 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1393a48e-97d3-4b73-a004-602e46363072 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:23.916208 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1393a48e-97d3-4b73-a004-602e46363072 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:23.991118 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1393a48e-97d3-4b73-a004-602e46363072 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 14 microversion: 2.1 time: 0.089597 Oct 13 04:25:23.998473 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 512/1035] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:23 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:25:24.023402 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1231072a-c3a9-4c58-8b21-e0aef6fd7daf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:24.025048 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-1231072a-c3a9-4c58-8b21-e0aef6fd7daf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:24.032576 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1231072a-c3a9-4c58-8b21-e0aef6fd7daf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:24.033257 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1231072a-c3a9-4c58-8b21-e0aef6fd7daf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:24.034223 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1231072a-c3a9-4c58-8b21-e0aef6fd7daf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:24.034805 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1231072a-c3a9-4c58-8b21-e0aef6fd7daf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:24.111917 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-1231072a-c3a9-4c58-8b21-e0aef6fd7daf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.092067 Oct 13 04:25:24.113276 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 524/1036] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:24 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:25.002839 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d2fda093-0add-4266-84e2-80313760a0da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:25.004701 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d2fda093-0add-4266-84e2-80313760a0da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:25.016550 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d2fda093-0add-4266-84e2-80313760a0da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:25.017332 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d2fda093-0add-4266-84e2-80313760a0da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:25.018326 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d2fda093-0add-4266-84e2-80313760a0da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:25.018919 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d2fda093-0add-4266-84e2-80313760a0da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:25.084003 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d2fda093-0add-4266-84e2-80313760a0da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 14 microversion: 2.1 time: 0.085128 Oct 13 04:25:25.084918 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 513/1037] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:24 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:25:25.125057 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-eb8a488e-179d-408a-bee7-f10f32ad8680 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:25.126234 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-eb8a488e-179d-408a-bee7-f10f32ad8680 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:25.133316 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-eb8a488e-179d-408a-bee7-f10f32ad8680 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:25.134023 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-eb8a488e-179d-408a-bee7-f10f32ad8680 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:25.134800 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-eb8a488e-179d-408a-bee7-f10f32ad8680 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:25.135224 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-eb8a488e-179d-408a-bee7-f10f32ad8680 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:25.200551 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-eb8a488e-179d-408a-bee7-f10f32ad8680 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.079717 Oct 13 04:25:25.204530 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 525/1038] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:25 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:26.099173 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8e5d2076-7087-4daf-ac5d-5bf844001fe1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:26.100322 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-8e5d2076-7087-4daf-ac5d-5bf844001fe1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:26.107999 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8e5d2076-7087-4daf-ac5d-5bf844001fe1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:26.109401 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8e5d2076-7087-4daf-ac5d-5bf844001fe1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:26.109401 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8e5d2076-7087-4daf-ac5d-5bf844001fe1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:26.109848 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8e5d2076-7087-4daf-ac5d-5bf844001fe1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:26.215767 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-43c1c416-dbf2-4e06-a1d9-9b3a85e9938b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:26.216816 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-43c1c416-dbf2-4e06-a1d9-9b3a85e9938b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:26.224355 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-43c1c416-dbf2-4e06-a1d9-9b3a85e9938b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:26.224788 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-43c1c416-dbf2-4e06-a1d9-9b3a85e9938b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:26.225585 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-43c1c416-dbf2-4e06-a1d9-9b3a85e9938b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:26.226039 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-43c1c416-dbf2-4e06-a1d9-9b3a85e9938b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:30.160525 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-8e5d2076-7087-4daf-ac5d-5bf844001fe1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 14 microversion: 2.1 time: 4.065287 Oct 13 04:25:30.161174 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 514/1039] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:26 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 14 bytes in 4067 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 04:25:30.166738 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-43c1c416-dbf2-4e06-a1d9-9b3a85e9938b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 3.954828 Oct 13 04:25:30.167982 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 526/1040] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:26 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 3957 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:30.335069 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f4b43090-39e3-42ce-b9b8-9534991b0957 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Action: 'create', calling method: .version_select at 0x7f33f6cf78b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-975192895"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:30.353315 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-f4b43090-39e3-42ce-b9b8-9534991b0957 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Getting quotas for project 8215b3ac605f4c6ab2b0c473f2de2930. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:25:30.356954 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-f4b43090-39e3-42ce-b9b8-9534991b0957 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Getting quotas for user bdcf5f47f87a4c06802f7db012bf8412 and project 8215b3ac605f4c6ab2b0c473f2de2930. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:25:30.457396 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-f4b43090-39e3-42ce-b9b8-9534991b0957 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Getting quotas for project 8215b3ac605f4c6ab2b0c473f2de2930. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:25:30.461144 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-f4b43090-39e3-42ce-b9b8-9534991b0957 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Getting quotas for user bdcf5f47f87a4c06802f7db012bf8412 and project 8215b3ac605f4c6ab2b0c473f2de2930. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:25:30.477628 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f4b43090-39e3-42ce-b9b8-9534991b0957 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.315163 Oct 13 04:25:30.478237 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 515/1041] 10.222.0.55 () {60 vars in 1157 bytes} [Wed Oct 13 04:25:30 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:31.179070 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-09cfb8e6-ddb1-4983-93e7-4a88920bc143 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:31.180354 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-09cfb8e6-ddb1-4983-93e7-4a88920bc143 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:31.187063 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7104333f-5ae2-4095-82d8-2275b16d8c09 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:31.190658 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-09cfb8e6-ddb1-4983-93e7-4a88920bc143 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:31.190792 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7104333f-5ae2-4095-82d8-2275b16d8c09 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:31.191388 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-09cfb8e6-ddb1-4983-93e7-4a88920bc143 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:31.192648 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-09cfb8e6-ddb1-4983-93e7-4a88920bc143 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:31.193221 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-09cfb8e6-ddb1-4983-93e7-4a88920bc143 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:31.202005 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7104333f-5ae2-4095-82d8-2275b16d8c09 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:31.205596 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7104333f-5ae2-4095-82d8-2275b16d8c09 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:31.206973 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7104333f-5ae2-4095-82d8-2275b16d8c09 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:31.208712 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7104333f-5ae2-4095-82d8-2275b16d8c09 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:31.280730 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-09cfb8e6-ddb1-4983-93e7-4a88920bc143 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.105461 Oct 13 04:25:31.284821 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 516/1042] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:31 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:31.290101 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7104333f-5ae2-4095-82d8-2275b16d8c09 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 14 microversion: 2.1 time: 0.121583 Oct 13 04:25:31.290735 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 527/1043] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:31 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:25:32.293439 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8b5f5165-0aaf-44de-83ae-0ce72b11fb70 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:32.294522 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-8b5f5165-0aaf-44de-83ae-0ce72b11fb70 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:32.300864 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-fd5e47e5-0849-4932-a602-97ce8d083ce5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:32.301626 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8b5f5165-0aaf-44de-83ae-0ce72b11fb70 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:32.302100 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8b5f5165-0aaf-44de-83ae-0ce72b11fb70 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:32.302236 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-fd5e47e5-0849-4932-a602-97ce8d083ce5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:32.302862 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8b5f5165-0aaf-44de-83ae-0ce72b11fb70 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:32.303286 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8b5f5165-0aaf-44de-83ae-0ce72b11fb70 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:32.308767 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fd5e47e5-0849-4932-a602-97ce8d083ce5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:32.309206 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fd5e47e5-0849-4932-a602-97ce8d083ce5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:32.310001 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fd5e47e5-0849-4932-a602-97ce8d083ce5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:32.310419 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fd5e47e5-0849-4932-a602-97ce8d083ce5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:35.949084 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-8b5f5165-0aaf-44de-83ae-0ce72b11fb70 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 3.659578 Oct 13 04:25:35.950055 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 517/1044] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:32 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 3662 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:35.963363 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-fd5e47e5-0849-4932-a602-97ce8d083ce5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 18449 microversion: 2.1 time: 3.666357 Oct 13 04:25:35.964787 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 528/1045] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:32 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 18449 bytes in 3668 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:25:36.962670 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-50180bed-15c1-4546-b95b-0c78a6a09c5c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:36.963717 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-50180bed-15c1-4546-b95b-0c78a6a09c5c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:36.972947 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-50180bed-15c1-4546-b95b-0c78a6a09c5c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:36.973406 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-50180bed-15c1-4546-b95b-0c78a6a09c5c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:36.974222 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-50180bed-15c1-4546-b95b-0c78a6a09c5c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:36.974616 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-50180bed-15c1-4546-b95b-0c78a6a09c5c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:36.977139 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e15434ed-9adc-4b21-a863-d11b8a1f5d91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:36.978370 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e15434ed-9adc-4b21-a863-d11b8a1f5d91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:36.988648 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e15434ed-9adc-4b21-a863-d11b8a1f5d91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:36.989091 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e15434ed-9adc-4b21-a863-d11b8a1f5d91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:36.989881 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e15434ed-9adc-4b21-a863-d11b8a1f5d91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:36.990300 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e15434ed-9adc-4b21-a863-d11b8a1f5d91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:37.054209 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-50180bed-15c1-4546-b95b-0c78a6a09c5c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.095377 Oct 13 04:25:37.055125 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 518/1046] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:36 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:37.127658 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e15434ed-9adc-4b21-a863-d11b8a1f5d91 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 19774 microversion: 2.1 time: 0.155425 Oct 13 04:25:37.128244 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 529/1047] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:36 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 19774 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:25:38.066844 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a3bd42c2-27ab-42d9-86f6-a54f1821f06c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:38.067867 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a3bd42c2-27ab-42d9-86f6-a54f1821f06c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:38.074533 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a3bd42c2-27ab-42d9-86f6-a54f1821f06c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:38.074969 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a3bd42c2-27ab-42d9-86f6-a54f1821f06c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:38.075731 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a3bd42c2-27ab-42d9-86f6-a54f1821f06c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:38.076181 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a3bd42c2-27ab-42d9-86f6-a54f1821f06c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:38.139874 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-34ab8b50-ab3d-4403-ba86-dc18473047b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:38.140858 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-34ab8b50-ab3d-4403-ba86-dc18473047b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:38.141379 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a3bd42c2-27ab-42d9-86f6-a54f1821f06c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.078272 Oct 13 04:25:38.143074 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 519/1048] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:38 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:38.147768 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-34ab8b50-ab3d-4403-ba86-dc18473047b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:38.148209 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-34ab8b50-ab3d-4403-ba86-dc18473047b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:38.148975 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-34ab8b50-ab3d-4403-ba86-dc18473047b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:38.149399 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-34ab8b50-ab3d-4403-ba86-dc18473047b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:38.236968 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-34ab8b50-ab3d-4403-ba86-dc18473047b0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 22168 microversion: 2.1 time: 0.100709 Oct 13 04:25:38.238069 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 530/1049] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:38 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 22168 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:25:39.160678 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c2994e01-36b0-4a4c-9a50-69443f5eca75 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:39.162799 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c2994e01-36b0-4a4c-9a50-69443f5eca75 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:39.173661 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2994e01-36b0-4a4c-9a50-69443f5eca75 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:39.174461 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2994e01-36b0-4a4c-9a50-69443f5eca75 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:39.175780 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2994e01-36b0-4a4c-9a50-69443f5eca75 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:39.176476 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2994e01-36b0-4a4c-9a50-69443f5eca75 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:39.248265 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c2994e01-36b0-4a4c-9a50-69443f5eca75 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.095413 Oct 13 04:25:39.249519 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 520/1050] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:39 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:39.249675 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4f5c96ad-f103-44f0-a15a-8444f9e8ad47 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:39.250410 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4f5c96ad-f103-44f0-a15a-8444f9e8ad47 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:39.257064 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4f5c96ad-f103-44f0-a15a-8444f9e8ad47 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:39.257505 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4f5c96ad-f103-44f0-a15a-8444f9e8ad47 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:39.258305 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4f5c96ad-f103-44f0-a15a-8444f9e8ad47 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:39.258729 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4f5c96ad-f103-44f0-a15a-8444f9e8ad47 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:39.358470 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4f5c96ad-f103-44f0-a15a-8444f9e8ad47 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 23604 microversion: 2.1 time: 0.113127 Oct 13 04:25:39.359123 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 531/1051] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:39 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 23604 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:25:40.262827 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-76f5a5b1-0238-4a6e-b664-78c2a7e40fa3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:40.263918 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-76f5a5b1-0238-4a6e-b664-78c2a7e40fa3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:40.271885 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-76f5a5b1-0238-4a6e-b664-78c2a7e40fa3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:40.272155 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-76f5a5b1-0238-4a6e-b664-78c2a7e40fa3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:40.272788 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-76f5a5b1-0238-4a6e-b664-78c2a7e40fa3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:40.273249 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-76f5a5b1-0238-4a6e-b664-78c2a7e40fa3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:40.293198 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-12fc8116-e80b-45d4-a6bb-88699f15782e tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:40.293890 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-12fc8116-e80b-45d4-a6bb-88699f15782e tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:40.305353 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-12fc8116-e80b-45d4-a6bb-88699f15782e tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:40.305830 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-12fc8116-e80b-45d4-a6bb-88699f15782e tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:40.306617 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-12fc8116-e80b-45d4-a6bb-88699f15782e tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:40.307039 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-12fc8116-e80b-45d4-a6bb-88699f15782e tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:40.348758 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-76f5a5b1-0238-4a6e-b664-78c2a7e40fa3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.090404 Oct 13 04:25:40.352796 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 521/1052] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:40 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:40.373329 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0d31b106-0a17-4671-90cc-4a3e89833927 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:40.374379 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0d31b106-0a17-4671-90cc-4a3e89833927 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:40.381129 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0d31b106-0a17-4671-90cc-4a3e89833927 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:40.381747 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0d31b106-0a17-4671-90cc-4a3e89833927 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:40.382998 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0d31b106-0a17-4671-90cc-4a3e89833927 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:40.383213 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0d31b106-0a17-4671-90cc-4a3e89833927 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:40.397049 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.objects.instance [None req-12fc8116-e80b-45d4-a6bb-88699f15782e tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lazy-loading 'services' on Instance uuid 093c7eca-94da-41d6-b83c-8f20720c2124 {{(pid=108260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:25:40.476355 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0d31b106-0a17-4671-90cc-4a3e89833927 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 24795 microversion: 2.1 time: 0.109520 Oct 13 04:25:40.480507 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 522/1053] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:40 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 24795 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:25:40.480793 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-12fc8116-e80b-45d4-a6bb-88699f15782e tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "DELETE /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124/os-volume_attachments/931e832b-d0bb-4cbd-95cb-a579fe03ff45" status: 202 len: 0 microversion: 2.1 time: 0.192057 Oct 13 04:25:40.481024 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 532/1054] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Oct 13 04:25:40 2021] DELETE /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124/os-volume_attachments/931e832b-d0bb-4cbd-95cb-a579fe03ff45 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:41.361817 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c5d6d14a-abfb-4c66-a582-dc3969b009e4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:41.363502 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c5d6d14a-abfb-4c66-a582-dc3969b009e4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:41.370522 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c5d6d14a-abfb-4c66-a582-dc3969b009e4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:41.371365 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c5d6d14a-abfb-4c66-a582-dc3969b009e4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:41.372918 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c5d6d14a-abfb-4c66-a582-dc3969b009e4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:41.373326 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c5d6d14a-abfb-4c66-a582-dc3969b009e4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:41.468415 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c5d6d14a-abfb-4c66-a582-dc3969b009e4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.111544 Oct 13 04:25:41.468968 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 523/1055] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:41 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:41.489152 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-033b9719-d669-4e82-ae38-313546e31c74 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:41.490183 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-033b9719-d669-4e82-ae38-313546e31c74 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:41.496561 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-033b9719-d669-4e82-ae38-313546e31c74 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:41.496992 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-033b9719-d669-4e82-ae38-313546e31c74 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:41.497828 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-033b9719-d669-4e82-ae38-313546e31c74 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:41.498248 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-033b9719-d669-4e82-ae38-313546e31c74 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:41.595904 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3c646787-3a16-417e-8a12-46cbc04a43c6 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:41.596513 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3c646787-3a16-417e-8a12-46cbc04a43c6 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:41.596826 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-033b9719-d669-4e82-ae38-313546e31c74 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 25733 microversion: 2.1 time: 0.111396 Oct 13 04:25:41.597822 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 533/1056] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:41 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 25733 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:25:41.603920 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3c646787-3a16-417e-8a12-46cbc04a43c6 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:41.604397 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3c646787-3a16-417e-8a12-46cbc04a43c6 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:41.605317 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3c646787-3a16-417e-8a12-46cbc04a43c6 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:41.605856 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3c646787-3a16-417e-8a12-46cbc04a43c6 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:41.630741 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3c646787-3a16-417e-8a12-46cbc04a43c6 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Going to try to terminate instance {{(pid=108259) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:25:41.709712 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3c646787-3a16-417e-8a12-46cbc04a43c6 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "DELETE /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124" status: 204 len: 0 microversion: 2.1 time: 0.117898 Oct 13 04:25:41.710259 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 524/1057] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:25:41 2021] DELETE /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:25:41.719255 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-13ec880b-38a2-498b-a9d1-fb5961e85a49 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:41.720211 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-13ec880b-38a2-498b-a9d1-fb5961e85a49 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:41.726537 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-13ec880b-38a2-498b-a9d1-fb5961e85a49 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:41.726977 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-13ec880b-38a2-498b-a9d1-fb5961e85a49 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:41.727885 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-13ec880b-38a2-498b-a9d1-fb5961e85a49 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:41.728311 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-13ec880b-38a2-498b-a9d1-fb5961e85a49 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:41.866929 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-13ec880b-38a2-498b-a9d1-fb5961e85a49 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:41.874561 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-13ec880b-38a2-498b-a9d1-fb5961e85a49 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124" status: 200 len: 1514 microversion: 2.1 time: 0.159688 Oct 13 04:25:41.875302 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 534/1058] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:41 2021] GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:42.480984 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7116da5d-9236-4fb9-adef-e5707dac0b99 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:42.482031 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7116da5d-9236-4fb9-adef-e5707dac0b99 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:42.488154 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7116da5d-9236-4fb9-adef-e5707dac0b99 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:42.488665 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7116da5d-9236-4fb9-adef-e5707dac0b99 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:42.489345 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7116da5d-9236-4fb9-adef-e5707dac0b99 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:42.489806 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7116da5d-9236-4fb9-adef-e5707dac0b99 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:42.559974 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7116da5d-9236-4fb9-adef-e5707dac0b99 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.082875 Oct 13 04:25:42.560625 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 525/1059] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:42 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:42.609279 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-198f30a8-d397-4a8a-a669-d6a9e2469745 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:42.610233 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-198f30a8-d397-4a8a-a669-d6a9e2469745 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:42.616622 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-198f30a8-d397-4a8a-a669-d6a9e2469745 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:42.617061 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-198f30a8-d397-4a8a-a669-d6a9e2469745 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:42.617854 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-198f30a8-d397-4a8a-a669-d6a9e2469745 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:42.618276 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-198f30a8-d397-4a8a-a669-d6a9e2469745 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:42.705510 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-198f30a8-d397-4a8a-a669-d6a9e2469745 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 26609 microversion: 2.1 time: 0.099447 Oct 13 04:25:42.706345 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 535/1060] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:42 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 26609 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:25:42.897178 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-fade48d6-6a50-4595-9b49-fda2ec271c26 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:42.898350 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-fade48d6-6a50-4595-9b49-fda2ec271c26 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:42.909602 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fade48d6-6a50-4595-9b49-fda2ec271c26 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:42.910399 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fade48d6-6a50-4595-9b49-fda2ec271c26 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:42.911626 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fade48d6-6a50-4595-9b49-fda2ec271c26 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:42.912384 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-fade48d6-6a50-4595-9b49-fda2ec271c26 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:43.039552 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-fade48d6-6a50-4595-9b49-fda2ec271c26 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:43.047061 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-fade48d6-6a50-4595-9b49-fda2ec271c26 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124" status: 200 len: 1514 microversion: 2.1 time: 0.156780 Oct 13 04:25:43.047610 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 526/1061] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:42 2021] GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:43.572800 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-59656d46-8c13-42aa-87d3-bfdb8335b78a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:43.573946 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-59656d46-8c13-42aa-87d3-bfdb8335b78a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:43.580767 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-59656d46-8c13-42aa-87d3-bfdb8335b78a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:43.581203 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-59656d46-8c13-42aa-87d3-bfdb8335b78a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:43.581985 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-59656d46-8c13-42aa-87d3-bfdb8335b78a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:43.582414 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-59656d46-8c13-42aa-87d3-bfdb8335b78a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:43.650455 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-59656d46-8c13-42aa-87d3-bfdb8335b78a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.081749 Oct 13 04:25:43.651171 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 536/1062] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:43 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:43.721590 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8411891f-ee1b-4ece-baf3-ef663e148159 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:43.722989 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-8411891f-ee1b-4ece-baf3-ef663e148159 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:43.731718 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8411891f-ee1b-4ece-baf3-ef663e148159 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:43.732156 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8411891f-ee1b-4ece-baf3-ef663e148159 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:43.732902 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8411891f-ee1b-4ece-baf3-ef663e148159 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:43.733323 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8411891f-ee1b-4ece-baf3-ef663e148159 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:43.845273 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-8411891f-ee1b-4ece-baf3-ef663e148159 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 27289 microversion: 2.1 time: 0.128871 Oct 13 04:25:43.846034 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 527/1063] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:43 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 27289 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:25:44.067589 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ecb2443a-81ec-48e3-a739-ce2438b04534 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:44.067589 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ecb2443a-81ec-48e3-a739-ce2438b04534 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:44.073149 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ecb2443a-81ec-48e3-a739-ce2438b04534 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:44.073592 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ecb2443a-81ec-48e3-a739-ce2438b04534 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:44.074378 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ecb2443a-81ec-48e3-a739-ce2438b04534 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:44.074797 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ecb2443a-81ec-48e3-a739-ce2438b04534 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:44.291377 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-ecb2443a-81ec-48e3-a739-ce2438b04534 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893b2d39d23f49688d9535132468af8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e3664217546579b7f55d3081e6eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:25:44.298794 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ecb2443a-81ec-48e3-a739-ce2438b04534 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124" status: 200 len: 1514 microversion: 2.1 time: 0.237532 Oct 13 04:25:44.299337 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 537/1064] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:44 2021] GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124 => generated 1514 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:25:44.486160 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-93fc4598-3cbf-42c3-bde1-3adac7ea7cb1 req-ffeb2797-f443-40b1-8dcb-8efe600b6182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "093c7eca-94da-41d6-b83c-8f20720c2124", "name": "network-vif-deleted", "tag": "13e9a5b6-1fe7-42c6-84ed-1a4c1ef0bf3b"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:44.488034 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:25:44.488034 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:25:44.495936 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-93fc4598-3cbf-42c3-bde1-3adac7ea7cb1 req-ffeb2797-f443-40b1-8dcb-8efe600b6182 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:44.496414 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-93fc4598-3cbf-42c3-bde1-3adac7ea7cb1 req-ffeb2797-f443-40b1-8dcb-8efe600b6182 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:44.508244 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-93fc4598-3cbf-42c3-bde1-3adac7ea7cb1 req-ffeb2797-f443-40b1-8dcb-8efe600b6182 service nova] Creating event network-vif-deleted:13e9a5b6-1fe7-42c6-84ed-1a4c1ef0bf3b for instance 093c7eca-94da-41d6-b83c-8f20720c2124 on hv-cinder-81275 Oct 13 04:25:44.513577 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-93fc4598-3cbf-42c3-bde1-3adac7ea7cb1 req-ffeb2797-f443-40b1-8dcb-8efe600b6182 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031356 Oct 13 04:25:44.514784 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 528/1065] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:25:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:25:44.665932 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c93b10d2-2b53-4f07-aa6a-1e91de67a1a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:44.666956 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c93b10d2-2b53-4f07-aa6a-1e91de67a1a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:44.673068 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c93b10d2-2b53-4f07-aa6a-1e91de67a1a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:44.673534 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c93b10d2-2b53-4f07-aa6a-1e91de67a1a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:44.674490 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c93b10d2-2b53-4f07-aa6a-1e91de67a1a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:44.674915 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c93b10d2-2b53-4f07-aa6a-1e91de67a1a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:44.749150 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c93b10d2-2b53-4f07-aa6a-1e91de67a1a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.090026 Oct 13 04:25:44.749847 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 538/1066] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:44 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:44.859070 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-92e12c19-f1d2-4673-b568-0060d4c2e166 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:44.860422 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-92e12c19-f1d2-4673-b568-0060d4c2e166 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:44.869443 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-92e12c19-f1d2-4673-b568-0060d4c2e166 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:44.869916 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-92e12c19-f1d2-4673-b568-0060d4c2e166 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:44.870783 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-92e12c19-f1d2-4673-b568-0060d4c2e166 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:44.871207 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-92e12c19-f1d2-4673-b568-0060d4c2e166 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:44.955656 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-92e12c19-f1d2-4673-b568-0060d4c2e166 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 27699 microversion: 2.1 time: 0.100791 Oct 13 04:25:44.956442 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 529/1067] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:44 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 27699 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:25:45.320814 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9502e3ec-1e1b-4ad2-9950-369498a01937 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:25:45.321751 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9502e3ec-1e1b-4ad2-9950-369498a01937 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] [instance: 093c7eca-94da-41d6-b83c-8f20720c2124] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:45.329312 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9502e3ec-1e1b-4ad2-9950-369498a01937 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:45.329787 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9502e3ec-1e1b-4ad2-9950-369498a01937 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:45.330584 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9502e3ec-1e1b-4ad2-9950-369498a01937 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:45.330997 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9502e3ec-1e1b-4ad2-9950-369498a01937 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:45.344594 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-9502e3ec-1e1b-4ad2-9950-369498a01937 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] HTTP exception thrown: Instance 093c7eca-94da-41d6-b83c-8f20720c2124 could not be found. Oct 13 04:25:45.345159 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9502e3ec-1e1b-4ad2-9950-369498a01937 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] Returning 404 to user: Instance 093c7eca-94da-41d6-b83c-8f20720c2124 could not be found. {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:25:45.346002 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9502e3ec-1e1b-4ad2-9950-369498a01937 tempest-VolumesSnapshotTestJSON-1296409712 tempest-VolumesSnapshotTestJSON-1296409712-project] 10.222.0.55 "GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124" status: 404 len: 111 microversion: 2.1 time: 0.031573 Oct 13 04:25:45.346527 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 539/1068] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:25:45 2021] GET /compute/v2.1/servers/093c7eca-94da-41d6-b83c-8f20720c2124 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:25:45.763702 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ac111286-b7e5-4028-bec0-f697b033ba72 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:45.764778 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ac111286-b7e5-4028-bec0-f697b033ba72 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:45.771443 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ac111286-b7e5-4028-bec0-f697b033ba72 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:45.771896 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ac111286-b7e5-4028-bec0-f697b033ba72 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:45.772678 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ac111286-b7e5-4028-bec0-f697b033ba72 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:45.773103 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ac111286-b7e5-4028-bec0-f697b033ba72 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:45.843012 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ac111286-b7e5-4028-bec0-f697b033ba72 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.084280 Oct 13 04:25:45.843545 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 530/1069] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:45 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:45.970986 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-fd4be717-bd42-49dc-b97e-5d91e1ff0209 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:45.972456 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-fd4be717-bd42-49dc-b97e-5d91e1ff0209 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:45.981323 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fd4be717-bd42-49dc-b97e-5d91e1ff0209 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:45.981810 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fd4be717-bd42-49dc-b97e-5d91e1ff0209 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:45.982560 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fd4be717-bd42-49dc-b97e-5d91e1ff0209 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:45.982984 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fd4be717-bd42-49dc-b97e-5d91e1ff0209 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:46.066200 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-fd4be717-bd42-49dc-b97e-5d91e1ff0209 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 27949 microversion: 2.1 time: 0.101265 Oct 13 04:25:46.066851 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 540/1070] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:45 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 27949 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:25:46.855534 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-9f50f83f-8221-4a12-abfe-33175408b49b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:46.856526 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-9f50f83f-8221-4a12-abfe-33175408b49b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:46.863279 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9f50f83f-8221-4a12-abfe-33175408b49b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:46.863719 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9f50f83f-8221-4a12-abfe-33175408b49b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:46.864477 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9f50f83f-8221-4a12-abfe-33175408b49b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:46.864898 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9f50f83f-8221-4a12-abfe-33175408b49b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:46.927505 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-9f50f83f-8221-4a12-abfe-33175408b49b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.076046 Oct 13 04:25:46.928112 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 531/1071] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:46 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:47.079849 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-03975e4c-f4bd-4d45-97c7-3559ebde3bf6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:47.080849 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-03975e4c-f4bd-4d45-97c7-3559ebde3bf6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:47.088389 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-03975e4c-f4bd-4d45-97c7-3559ebde3bf6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:47.089022 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-03975e4c-f4bd-4d45-97c7-3559ebde3bf6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:47.089820 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-03975e4c-f4bd-4d45-97c7-3559ebde3bf6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:47.090247 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-03975e4c-f4bd-4d45-97c7-3559ebde3bf6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:47.179116 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-03975e4c-f4bd-4d45-97c7-3559ebde3bf6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28128 microversion: 2.1 time: 0.103533 Oct 13 04:25:47.179944 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 541/1072] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:47 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28128 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:25:47.940454 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-419fb5e0-0f87-46b1-92b7-d42add9618e0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:47.941439 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-419fb5e0-0f87-46b1-92b7-d42add9618e0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:47.948516 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-419fb5e0-0f87-46b1-92b7-d42add9618e0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:47.948948 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-419fb5e0-0f87-46b1-92b7-d42add9618e0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:47.949748 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-419fb5e0-0f87-46b1-92b7-d42add9618e0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:47.950167 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-419fb5e0-0f87-46b1-92b7-d42add9618e0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:48.192864 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-00d290ee-e837-4f9b-a831-a2fd6c3db2f6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:48.193930 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-00d290ee-e837-4f9b-a831-a2fd6c3db2f6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:48.200979 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-00d290ee-e837-4f9b-a831-a2fd6c3db2f6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:48.201418 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-00d290ee-e837-4f9b-a831-a2fd6c3db2f6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:48.202214 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-00d290ee-e837-4f9b-a831-a2fd6c3db2f6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:48.202655 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-00d290ee-e837-4f9b-a831-a2fd6c3db2f6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:52.751764 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-419fb5e0-0f87-46b1-92b7-d42add9618e0 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 4.815280 Oct 13 04:25:52.752847 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 532/1073] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:47 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 4817 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:52.760807 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-00d290ee-e837-4f9b-a831-a2fd6c3db2f6 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28128 microversion: 2.1 time: 4.571870 Oct 13 04:25:52.761477 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 542/1074] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:48 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28128 bytes in 4574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:25:53.764431 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-054aea38-15b6-4c34-833c-8f2cb5e24f10 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:53.765488 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-054aea38-15b6-4c34-833c-8f2cb5e24f10 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:53.772464 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-054aea38-15b6-4c34-833c-8f2cb5e24f10 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:53.772852 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3a6ab4d8-751a-492a-af46-50825fb3fc59 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:53.773327 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-054aea38-15b6-4c34-833c-8f2cb5e24f10 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:53.773874 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-3a6ab4d8-751a-492a-af46-50825fb3fc59 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:53.774034 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-054aea38-15b6-4c34-833c-8f2cb5e24f10 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:53.774427 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-054aea38-15b6-4c34-833c-8f2cb5e24f10 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:53.780778 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3a6ab4d8-751a-492a-af46-50825fb3fc59 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:53.781210 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3a6ab4d8-751a-492a-af46-50825fb3fc59 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:53.782007 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3a6ab4d8-751a-492a-af46-50825fb3fc59 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:53.782428 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-3a6ab4d8-751a-492a-af46-50825fb3fc59 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:53.852837 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-054aea38-15b6-4c34-833c-8f2cb5e24f10 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.091872 Oct 13 04:25:53.853877 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 533/1075] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:53 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:53.875908 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3a6ab4d8-751a-492a-af46-50825fb3fc59 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.107041 Oct 13 04:25:53.876523 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 543/1076] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:53 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:25:54.871893 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-6f9d2ed0-067a-4121-bcb6-2f0a6f9e2d9c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:54.873384 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-6f9d2ed0-067a-4121-bcb6-2f0a6f9e2d9c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:54.884144 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6f9d2ed0-067a-4121-bcb6-2f0a6f9e2d9c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:54.884872 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6f9d2ed0-067a-4121-bcb6-2f0a6f9e2d9c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:54.886200 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6f9d2ed0-067a-4121-bcb6-2f0a6f9e2d9c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:54.887054 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-6f9d2ed0-067a-4121-bcb6-2f0a6f9e2d9c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:54.890719 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b7dd3e29-4f28-4c7c-94a7-c78491273ed8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:54.891792 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b7dd3e29-4f28-4c7c-94a7-c78491273ed8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:54.898472 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b7dd3e29-4f28-4c7c-94a7-c78491273ed8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:54.898908 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b7dd3e29-4f28-4c7c-94a7-c78491273ed8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:54.899658 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b7dd3e29-4f28-4c7c-94a7-c78491273ed8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:54.900078 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b7dd3e29-4f28-4c7c-94a7-c78491273ed8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:54.984356 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-6f9d2ed0-067a-4121-bcb6-2f0a6f9e2d9c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.119014 Oct 13 04:25:54.985364 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 534/1077] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:54 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:54.988008 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b7dd3e29-4f28-4c7c-94a7-c78491273ed8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.102846 Oct 13 04:25:54.988974 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 544/1078] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:54 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:25:56.001665 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-950617f1-e0dd-425e-b133-9edc6b452d95 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:56.002833 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-950617f1-e0dd-425e-b133-9edc6b452d95 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:56.004161 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d0311542-f65e-4207-ae17-fe56322750a0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:56.005320 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d0311542-f65e-4207-ae17-fe56322750a0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:56.011934 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-950617f1-e0dd-425e-b133-9edc6b452d95 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:56.012631 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-950617f1-e0dd-425e-b133-9edc6b452d95 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:56.013141 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d0311542-f65e-4207-ae17-fe56322750a0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:56.013671 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d0311542-f65e-4207-ae17-fe56322750a0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:56.013943 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-950617f1-e0dd-425e-b133-9edc6b452d95 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:56.014585 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d0311542-f65e-4207-ae17-fe56322750a0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:56.014716 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-950617f1-e0dd-425e-b133-9edc6b452d95 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:56.015096 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d0311542-f65e-4207-ae17-fe56322750a0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:56.089250 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d0311542-f65e-4207-ae17-fe56322750a0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.089496 Oct 13 04:25:56.090840 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 545/1079] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:55 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:25:56.092020 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-950617f1-e0dd-425e-b133-9edc6b452d95 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.094945 Oct 13 04:25:56.095315 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 535/1080] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:55 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:57.103540 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4a78adac-db5a-449b-b0d9-9d0513cbcc15 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:57.104511 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4a78adac-db5a-449b-b0d9-9d0513cbcc15 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:57.107024 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d8b845dd-47ba-48e5-868b-6c867229a967 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:57.108029 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d8b845dd-47ba-48e5-868b-6c867229a967 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:57.111627 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4a78adac-db5a-449b-b0d9-9d0513cbcc15 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:57.112067 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4a78adac-db5a-449b-b0d9-9d0513cbcc15 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:57.112870 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4a78adac-db5a-449b-b0d9-9d0513cbcc15 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:57.113248 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4a78adac-db5a-449b-b0d9-9d0513cbcc15 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:57.114589 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d8b845dd-47ba-48e5-868b-6c867229a967 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:57.115036 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d8b845dd-47ba-48e5-868b-6c867229a967 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:57.115786 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d8b845dd-47ba-48e5-868b-6c867229a967 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:57.116204 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d8b845dd-47ba-48e5-868b-6c867229a967 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:57.184432 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4a78adac-db5a-449b-b0d9-9d0513cbcc15 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.085416 Oct 13 04:25:57.185076 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 546/1081] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:57 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:25:57.222528 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d8b845dd-47ba-48e5-868b-6c867229a967 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.119679 Oct 13 04:25:57.223170 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 536/1082] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:57 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:58.200454 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-304d3e71-3ad0-45a9-a931-4b85e993a945 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:58.201765 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-304d3e71-3ad0-45a9-a931-4b85e993a945 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:58.210048 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-304d3e71-3ad0-45a9-a931-4b85e993a945 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:58.210601 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-304d3e71-3ad0-45a9-a931-4b85e993a945 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:58.211545 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-304d3e71-3ad0-45a9-a931-4b85e993a945 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:58.212079 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-304d3e71-3ad0-45a9-a931-4b85e993a945 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:58.235556 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-534f919a-1443-4d74-a111-3e993ff840db tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:58.236885 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-534f919a-1443-4d74-a111-3e993ff840db tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:58.244177 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-534f919a-1443-4d74-a111-3e993ff840db tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:58.244757 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-534f919a-1443-4d74-a111-3e993ff840db tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:58.245663 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-534f919a-1443-4d74-a111-3e993ff840db tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:58.246105 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-534f919a-1443-4d74-a111-3e993ff840db tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:58.276856 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-304d3e71-3ad0-45a9-a931-4b85e993a945 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.082893 Oct 13 04:25:58.277549 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 547/1083] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:58 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:25:58.307826 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-534f919a-1443-4d74-a111-3e993ff840db tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.076178 Oct 13 04:25:58.308500 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 537/1084] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:58 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:25:59.294134 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-138ebbb1-291e-4bad-bc4e-023b83f489ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:59.295145 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-138ebbb1-291e-4bad-bc4e-023b83f489ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:59.302032 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-138ebbb1-291e-4bad-bc4e-023b83f489ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:59.302467 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-138ebbb1-291e-4bad-bc4e-023b83f489ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:59.303215 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-138ebbb1-291e-4bad-bc4e-023b83f489ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:59.303636 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-138ebbb1-291e-4bad-bc4e-023b83f489ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:59.320386 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-11ead0a2-85cd-417d-b7cd-ae91083018d1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:25:59.321460 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-11ead0a2-85cd-417d-b7cd-ae91083018d1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:25:59.328463 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-11ead0a2-85cd-417d-b7cd-ae91083018d1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:59.328899 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-11ead0a2-85cd-417d-b7cd-ae91083018d1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:59.329779 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-11ead0a2-85cd-417d-b7cd-ae91083018d1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:25:59.330214 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-11ead0a2-85cd-417d-b7cd-ae91083018d1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:25:59.378867 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-138ebbb1-291e-4bad-bc4e-023b83f489ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.092164 Oct 13 04:25:59.379509 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 548/1085] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:25:59 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:25:59.423633 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-11ead0a2-85cd-417d-b7cd-ae91083018d1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.106736 Oct 13 04:25:59.424622 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 538/1086] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:25:59 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:00.395549 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1093fab5-2c4e-4eac-a82b-3c6d9ee30f4c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:00.397110 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-1093fab5-2c4e-4eac-a82b-3c6d9ee30f4c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:00.406519 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1093fab5-2c4e-4eac-a82b-3c6d9ee30f4c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:00.406958 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1093fab5-2c4e-4eac-a82b-3c6d9ee30f4c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:00.407708 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1093fab5-2c4e-4eac-a82b-3c6d9ee30f4c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:00.408126 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1093fab5-2c4e-4eac-a82b-3c6d9ee30f4c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:00.441118 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0403b68b-ce43-4365-975d-daf630ba03a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:00.442470 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0403b68b-ce43-4365-975d-daf630ba03a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:00.452349 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0403b68b-ce43-4365-975d-daf630ba03a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:00.452940 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0403b68b-ce43-4365-975d-daf630ba03a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:00.454075 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0403b68b-ce43-4365-975d-daf630ba03a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:00.454579 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0403b68b-ce43-4365-975d-daf630ba03a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:03.810201 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-1093fab5-2c4e-4eac-a82b-3c6d9ee30f4c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 3.420809 Oct 13 04:26:03.811676 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 549/1087] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:00 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 3424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:03.813850 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0403b68b-ce43-4365-975d-daf630ba03a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 3.378623 Oct 13 04:26:03.816295 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 539/1088] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:00 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 3382 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:04.829511 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-cad53a10-9b6e-4ee5-b137-4b1375c5d771 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:04.831211 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-cad53a10-9b6e-4ee5-b137-4b1375c5d771 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:04.832666 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2fc8ea5d-e380-47c5-864e-5e5899a93ae4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:04.834330 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2fc8ea5d-e380-47c5-864e-5e5899a93ae4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:04.841463 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cad53a10-9b6e-4ee5-b137-4b1375c5d771 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:04.841934 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cad53a10-9b6e-4ee5-b137-4b1375c5d771 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:04.842701 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cad53a10-9b6e-4ee5-b137-4b1375c5d771 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:04.843131 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cad53a10-9b6e-4ee5-b137-4b1375c5d771 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:04.843721 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2fc8ea5d-e380-47c5-864e-5e5899a93ae4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:04.844160 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2fc8ea5d-e380-47c5-864e-5e5899a93ae4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:04.844905 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2fc8ea5d-e380-47c5-864e-5e5899a93ae4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:04.845334 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2fc8ea5d-e380-47c5-864e-5e5899a93ae4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:05.030016 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-cad53a10-9b6e-4ee5-b137-4b1375c5d771 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.207833 Oct 13 04:26:05.030697 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 550/1089] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:04 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:05.031814 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2fc8ea5d-e380-47c5-864e-5e5899a93ae4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.205981 Oct 13 04:26:05.033754 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 540/1090] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:04 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:06.043449 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-eabee6e1-ebd0-4546-b331-d52cb3f408f7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:06.044010 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-30b10529-08d7-4a89-bbff-34d7a03e3b14 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:06.044865 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-eabee6e1-ebd0-4546-b331-d52cb3f408f7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:06.045064 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-30b10529-08d7-4a89-bbff-34d7a03e3b14 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:06.051379 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-eabee6e1-ebd0-4546-b331-d52cb3f408f7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:06.051821 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-eabee6e1-ebd0-4546-b331-d52cb3f408f7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:06.051978 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30b10529-08d7-4a89-bbff-34d7a03e3b14 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:06.052326 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30b10529-08d7-4a89-bbff-34d7a03e3b14 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:06.052577 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-eabee6e1-ebd0-4546-b331-d52cb3f408f7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:06.053005 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-eabee6e1-ebd0-4546-b331-d52cb3f408f7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:06.053109 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30b10529-08d7-4a89-bbff-34d7a03e3b14 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:06.053512 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30b10529-08d7-4a89-bbff-34d7a03e3b14 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:06.119543 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-eabee6e1-ebd0-4546-b331-d52cb3f408f7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.080066 Oct 13 04:26:06.123732 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 551/1091] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:06 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:06.123900 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-30b10529-08d7-4a89-bbff-34d7a03e3b14 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.083313 Oct 13 04:26:06.126041 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 541/1092] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:06 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:07.132386 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b9988f2b-35c8-4d24-8523-ecdae7ebfb45 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:07.133299 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b9988f2b-35c8-4d24-8523-ecdae7ebfb45 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:07.135776 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c7846016-9e2c-426e-a1ec-90c47395a89e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:07.136831 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c7846016-9e2c-426e-a1ec-90c47395a89e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:07.139931 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b9988f2b-35c8-4d24-8523-ecdae7ebfb45 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:07.140281 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b9988f2b-35c8-4d24-8523-ecdae7ebfb45 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:07.141107 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b9988f2b-35c8-4d24-8523-ecdae7ebfb45 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:07.141457 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b9988f2b-35c8-4d24-8523-ecdae7ebfb45 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:07.143663 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7846016-9e2c-426e-a1ec-90c47395a89e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:07.144183 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7846016-9e2c-426e-a1ec-90c47395a89e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:07.144947 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7846016-9e2c-426e-a1ec-90c47395a89e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:07.145373 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c7846016-9e2c-426e-a1ec-90c47395a89e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:07.208512 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c7846016-9e2c-426e-a1ec-90c47395a89e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.076682 Oct 13 04:26:07.209193 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 542/1093] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:07 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:07.213133 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b9988f2b-35c8-4d24-8523-ecdae7ebfb45 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.084855 Oct 13 04:26:07.213881 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 552/1094] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:07 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:26:08.004404 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0fc5977d-cbce-4d9e-8216-9e517dac7436 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-699138062", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-975192895", "security_groups": [{"name": "tempest-secgroup-smoke-70120880"}], "block_device_mapping_v2": [{"uuid": "4565b96e-2114-4ca1-add2-35477273c34e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2425230-f9f9-4ed2-8964-6d1938379dee"}]}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:08.113524 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.network.neutron [None req-0fc5977d-cbce-4d9e-8216-9e517dac7436 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] validate_networks() for [('f2425230-f9f9-4ed2-8964-6d1938379dee', None, None, None, None, None)] {{(pid=108259) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:26:08.221340 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-cfcb90d4-b99b-4995-9d79-977aa5cee8c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:08.222433 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-cfcb90d4-b99b-4995-9d79-977aa5cee8c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:08.229195 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cfcb90d4-b99b-4995-9d79-977aa5cee8c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:08.229637 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cfcb90d4-b99b-4995-9d79-977aa5cee8c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:08.230408 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cfcb90d4-b99b-4995-9d79-977aa5cee8c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:08.230829 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cfcb90d4-b99b-4995-9d79-977aa5cee8c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:08.290126 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-cfcb90d4-b99b-4995-9d79-977aa5cee8c6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.072877 Oct 13 04:26:08.290756 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 553/1095] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:08 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:08.296035 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d0c3d983-874c-4d40-bd97-ac0a0c1919da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:08.297098 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d0c3d983-874c-4d40-bd97-ac0a0c1919da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:08.303689 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d0c3d983-874c-4d40-bd97-ac0a0c1919da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:08.304136 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d0c3d983-874c-4d40-bd97-ac0a0c1919da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:08.304893 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d0c3d983-874c-4d40-bd97-ac0a0c1919da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:08.305315 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d0c3d983-874c-4d40-bd97-ac0a0c1919da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:08.368026 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d0c3d983-874c-4d40-bd97-ac0a0c1919da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.075720 Oct 13 04:26:08.368577 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 554/1096] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:08 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:08.488244 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-0fc5977d-cbce-4d9e-8216-9e517dac7436 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Flavor limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:26:08.488778 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-0fc5977d-cbce-4d9e-8216-9e517dac7436 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Image limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:26:08.489077 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-0fc5977d-cbce-4d9e-8216-9e517dac7436 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Flavor pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:26:08.489500 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-0fc5977d-cbce-4d9e-8216-9e517dac7436 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Image pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:26:08.490041 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-0fc5977d-cbce-4d9e-8216-9e517dac7436 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:26:08.499942 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0fc5977d-cbce-4d9e-8216-9e517dac7436 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:08.500380 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0fc5977d-cbce-4d9e-8216-9e517dac7436 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:08.501163 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0fc5977d-cbce-4d9e-8216-9e517dac7436 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:08.501589 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0fc5977d-cbce-4d9e-8216-9e517dac7436 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:08.518056 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-0fc5977d-cbce-4d9e-8216-9e517dac7436 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Getting quotas for project 8215b3ac605f4c6ab2b0c473f2de2930. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:26:08.522255 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-0fc5977d-cbce-4d9e-8216-9e517dac7436 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Getting quotas for user bdcf5f47f87a4c06802f7db012bf8412 and project 8215b3ac605f4c6ab2b0c473f2de2930. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:26:08.583243 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0fc5977d-cbce-4d9e-8216-9e517dac7436 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Going to run 1 instances... {{(pid=108259) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:26:08.585514 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0fc5977d-cbce-4d9e-8216-9e517dac7436 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4565b96e-2114-4ca1-add2-35477273c34e',volume_size=None,volume_type=None)] {{(pid=108259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:26:08.718562 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0fc5977d-cbce-4d9e-8216-9e517dac7436 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.718153 Oct 13 04:26:08.719229 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 543/1097] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Oct 13 04:26:07 2021] POST /compute/v2.1/servers => generated 404 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 04:26:08.729652 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-cfeb7f4d-0e60-4d77-a7c3-f5e056ad1b43 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:08.730611 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-cfeb7f4d-0e60-4d77-a7c3-f5e056ad1b43 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:08.788891 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-cfeb7f4d-0e60-4d77-a7c3-f5e056ad1b43 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:08.795611 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-cfeb7f4d-0e60-4d77-a7c3-f5e056ad1b43 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1093 microversion: 2.1 time: 0.069959 Oct 13 04:26:08.796443 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 555/1098] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:26:08 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:26:09.303292 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5405cbef-4fac-4833-8d84-a04620cc36d7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:09.304289 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-5405cbef-4fac-4833-8d84-a04620cc36d7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:09.312092 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5405cbef-4fac-4833-8d84-a04620cc36d7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:09.312528 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5405cbef-4fac-4833-8d84-a04620cc36d7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:09.313293 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5405cbef-4fac-4833-8d84-a04620cc36d7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:09.313899 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5405cbef-4fac-4833-8d84-a04620cc36d7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:09.379704 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6377926a-11b7-4b13-8939-0f617e23dd8f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:09.380668 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6377926a-11b7-4b13-8939-0f617e23dd8f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:09.387532 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6377926a-11b7-4b13-8939-0f617e23dd8f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:09.387969 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6377926a-11b7-4b13-8939-0f617e23dd8f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:09.388133 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-5405cbef-4fac-4833-8d84-a04620cc36d7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.089064 Oct 13 04:26:09.388663 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 544/1099] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:09 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:09.388795 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6377926a-11b7-4b13-8939-0f617e23dd8f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:09.389098 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6377926a-11b7-4b13-8939-0f617e23dd8f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:09.452984 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6377926a-11b7-4b13-8939-0f617e23dd8f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.076856 Oct 13 04:26:09.453911 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 556/1100] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:09 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:26:09.815175 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-84de3fa6-aa98-4068-b7d1-9485801375ea tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:09.815751 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-84de3fa6-aa98-4068-b7d1-9485801375ea tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:09.822585 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-84de3fa6-aa98-4068-b7d1-9485801375ea tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:09.823030 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-84de3fa6-aa98-4068-b7d1-9485801375ea tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:09.823780 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-84de3fa6-aa98-4068-b7d1-9485801375ea tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:09.824202 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-84de3fa6-aa98-4068-b7d1-9485801375ea tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:09.888554 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-84de3fa6-aa98-4068-b7d1-9485801375ea tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:09.895996 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-84de3fa6-aa98-4068-b7d1-9485801375ea tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1191 microversion: 2.1 time: 0.086185 Oct 13 04:26:09.896532 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 545/1101] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:26:09 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:26:10.400720 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-84a50d13-ea40-4d75-a937-0a9bfa75c9aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:10.402761 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-84a50d13-ea40-4d75-a937-0a9bfa75c9aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:10.410445 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84a50d13-ea40-4d75-a937-0a9bfa75c9aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:10.410886 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84a50d13-ea40-4d75-a937-0a9bfa75c9aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:10.411651 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84a50d13-ea40-4d75-a937-0a9bfa75c9aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:10.412076 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84a50d13-ea40-4d75-a937-0a9bfa75c9aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:10.464440 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-79d5a1c8-245d-4293-8185-ef20544f2a54 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:10.465365 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-79d5a1c8-245d-4293-8185-ef20544f2a54 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:10.471631 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-79d5a1c8-245d-4293-8185-ef20544f2a54 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:10.472068 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-79d5a1c8-245d-4293-8185-ef20544f2a54 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:10.472820 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-79d5a1c8-245d-4293-8185-ef20544f2a54 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:10.473239 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-79d5a1c8-245d-4293-8185-ef20544f2a54 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:10.478138 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-84a50d13-ea40-4d75-a937-0a9bfa75c9aa tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.081281 Oct 13 04:26:10.478817 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 557/1102] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:10 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:26:10.534416 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-79d5a1c8-245d-4293-8185-ef20544f2a54 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.073221 Oct 13 04:26:10.534812 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 546/1103] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:10 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:10.915608 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f8197d4f-0a84-42b2-9948-2d2895357223 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:10.916316 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f8197d4f-0a84-42b2-9948-2d2895357223 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:10.924296 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f8197d4f-0a84-42b2-9948-2d2895357223 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:10.924659 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f8197d4f-0a84-42b2-9948-2d2895357223 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:10.925420 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f8197d4f-0a84-42b2-9948-2d2895357223 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:10.925907 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f8197d4f-0a84-42b2-9948-2d2895357223 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:11.121528 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f8197d4f-0a84-42b2-9948-2d2895357223 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:11.129499 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f8197d4f-0a84-42b2-9948-2d2895357223 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1275 microversion: 2.1 time: 0.219009 Oct 13 04:26:11.130212 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 558/1104] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:26:10 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:26:11.345474 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-43d0cdcf-38a0-47ce-a684-55090421e6b7 req-d2a3b9a4-98f5-4ceb-ac74-9326616fec8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d26bf0b5-5228-42aa-89d4-3965eebb821b", "tag": "cbed6222-da96-4eeb-bab7-65423ecde122"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:11.347020 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:26:11.347020 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:26:11.355044 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-43d0cdcf-38a0-47ce-a684-55090421e6b7 req-d2a3b9a4-98f5-4ceb-ac74-9326616fec8b service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:11.355410 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-43d0cdcf-38a0-47ce-a684-55090421e6b7 req-d2a3b9a4-98f5-4ceb-ac74-9326616fec8b service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:11.374561 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-43d0cdcf-38a0-47ce-a684-55090421e6b7 req-d2a3b9a4-98f5-4ceb-ac74-9326616fec8b service nova] Creating event network-changed:cbed6222-da96-4eeb-bab7-65423ecde122 for instance d26bf0b5-5228-42aa-89d4-3965eebb821b on hv-cinder-81275 Oct 13 04:26:11.380146 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-43d0cdcf-38a0-47ce-a684-55090421e6b7 req-d2a3b9a4-98f5-4ceb-ac74-9326616fec8b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038862 Oct 13 04:26:11.381191 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 547/1105] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:26:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:26:11.490200 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-869f53dd-5267-44f6-8aa8-c68836bf5083 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:11.491434 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-869f53dd-5267-44f6-8aa8-c68836bf5083 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:11.497410 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-869f53dd-5267-44f6-8aa8-c68836bf5083 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:11.497952 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-869f53dd-5267-44f6-8aa8-c68836bf5083 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:11.498782 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-869f53dd-5267-44f6-8aa8-c68836bf5083 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:11.499260 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-869f53dd-5267-44f6-8aa8-c68836bf5083 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:11.546196 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-08c06a81-d4d2-427a-a2d8-2aff24d82fab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:11.547292 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-08c06a81-d4d2-427a-a2d8-2aff24d82fab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:11.553883 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-08c06a81-d4d2-427a-a2d8-2aff24d82fab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:11.554330 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-08c06a81-d4d2-427a-a2d8-2aff24d82fab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:11.555143 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-08c06a81-d4d2-427a-a2d8-2aff24d82fab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:11.555566 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-08c06a81-d4d2-427a-a2d8-2aff24d82fab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:11.562121 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-869f53dd-5267-44f6-8aa8-c68836bf5083 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.075975 Oct 13 04:26:11.562755 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 559/1106] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:11 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:11.625227 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-08c06a81-d4d2-427a-a2d8-2aff24d82fab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.082459 Oct 13 04:26:11.625465 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 548/1107] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:11 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:26:12.147597 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f18ac4c9-1a1f-4830-bb6f-c05f49dc7cc1 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:12.148221 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f18ac4c9-1a1f-4830-bb6f-c05f49dc7cc1 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:12.155596 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f18ac4c9-1a1f-4830-bb6f-c05f49dc7cc1 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:12.156036 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f18ac4c9-1a1f-4830-bb6f-c05f49dc7cc1 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:12.156802 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f18ac4c9-1a1f-4830-bb6f-c05f49dc7cc1 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:12.157226 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f18ac4c9-1a1f-4830-bb6f-c05f49dc7cc1 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:12.370809 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f18ac4c9-1a1f-4830-bb6f-c05f49dc7cc1 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:12.380014 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f18ac4c9-1a1f-4830-bb6f-c05f49dc7cc1 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1263 microversion: 2.1 time: 0.236577 Oct 13 04:26:12.380775 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 560/1108] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:26:12 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1263 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:26:12.574734 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7c2d70a0-33b7-483d-bf93-dec49a2254c9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:12.575804 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7c2d70a0-33b7-483d-bf93-dec49a2254c9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:12.587547 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7c2d70a0-33b7-483d-bf93-dec49a2254c9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:12.587986 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7c2d70a0-33b7-483d-bf93-dec49a2254c9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:12.588729 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7c2d70a0-33b7-483d-bf93-dec49a2254c9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:12.589150 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7c2d70a0-33b7-483d-bf93-dec49a2254c9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:12.636633 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-301e9e11-4aed-4319-96c8-c4bc8a9a80c7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:12.637554 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-301e9e11-4aed-4319-96c8-c4bc8a9a80c7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:12.644036 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-301e9e11-4aed-4319-96c8-c4bc8a9a80c7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:12.644486 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-301e9e11-4aed-4319-96c8-c4bc8a9a80c7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:12.645243 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-301e9e11-4aed-4319-96c8-c4bc8a9a80c7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:12.645701 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-301e9e11-4aed-4319-96c8-c4bc8a9a80c7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:12.762918 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7c2d70a0-33b7-483d-bf93-dec49a2254c9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.192067 Oct 13 04:26:12.763577 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 549/1109] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:12 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 13 04:26:12.822783 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-301e9e11-4aed-4319-96c8-c4bc8a9a80c7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.189090 Oct 13 04:26:12.823808 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 561/1110] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:12 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:26:13.403799 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-9fff30d1-9bb8-4a24-9de9-25bd40aa3b65 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:13.404942 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-9fff30d1-9bb8-4a24-9de9-25bd40aa3b65 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:13.412970 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9fff30d1-9bb8-4a24-9de9-25bd40aa3b65 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:13.413411 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9fff30d1-9bb8-4a24-9de9-25bd40aa3b65 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:13.414226 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9fff30d1-9bb8-4a24-9de9-25bd40aa3b65 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:13.415966 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9fff30d1-9bb8-4a24-9de9-25bd40aa3b65 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:13.547842 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-9fff30d1-9bb8-4a24-9de9-25bd40aa3b65 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:13.555688 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-9fff30d1-9bb8-4a24-9de9-25bd40aa3b65 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1263 microversion: 2.1 time: 0.159154 Oct 13 04:26:13.556259 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 550/1111] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:26:13 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:26:13.776314 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-0725f338-08ff-4baa-9640-a3c9bb313085 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:13.777629 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-0725f338-08ff-4baa-9640-a3c9bb313085 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:13.784257 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0725f338-08ff-4baa-9640-a3c9bb313085 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:13.784685 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0725f338-08ff-4baa-9640-a3c9bb313085 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:13.785428 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0725f338-08ff-4baa-9640-a3c9bb313085 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:13.785884 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0725f338-08ff-4baa-9640-a3c9bb313085 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:13.836373 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c86f377c-15b3-4429-913b-4a6612ee21b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:13.837274 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c86f377c-15b3-4429-913b-4a6612ee21b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:13.843731 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c86f377c-15b3-4429-913b-4a6612ee21b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:13.844151 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c86f377c-15b3-4429-913b-4a6612ee21b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:13.845657 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c86f377c-15b3-4429-913b-4a6612ee21b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:13.846106 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c86f377c-15b3-4429-913b-4a6612ee21b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:13.848666 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-0725f338-08ff-4baa-9640-a3c9bb313085 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.076412 Oct 13 04:26:13.849272 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 562/1112] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:13 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:13.907214 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c86f377c-15b3-4429-913b-4a6612ee21b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.074372 Oct 13 04:26:13.907832 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 551/1113] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:13 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:14.575682 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7c71e766-9a99-4f93-903e-38766a56d769 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:14.576635 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7c71e766-9a99-4f93-903e-38766a56d769 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:14.584287 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7c71e766-9a99-4f93-903e-38766a56d769 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:14.584727 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7c71e766-9a99-4f93-903e-38766a56d769 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:14.585481 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7c71e766-9a99-4f93-903e-38766a56d769 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:14.585940 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7c71e766-9a99-4f93-903e-38766a56d769 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:14.712964 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-7c71e766-9a99-4f93-903e-38766a56d769 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:14.723543 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7c71e766-9a99-4f93-903e-38766a56d769 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1263 microversion: 2.1 time: 0.153319 Oct 13 04:26:14.724666 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 563/1114] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:26:14 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:26:14.863248 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f51cf2c2-ccfd-4eec-8f5f-16d7ec3f9cb8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:14.864347 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f51cf2c2-ccfd-4eec-8f5f-16d7ec3f9cb8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:14.870996 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f51cf2c2-ccfd-4eec-8f5f-16d7ec3f9cb8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:14.871503 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f51cf2c2-ccfd-4eec-8f5f-16d7ec3f9cb8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:14.872278 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f51cf2c2-ccfd-4eec-8f5f-16d7ec3f9cb8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:14.872702 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f51cf2c2-ccfd-4eec-8f5f-16d7ec3f9cb8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:14.920157 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-bfc4ae31-0d09-4dc2-bbc3-77610ff6f87a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:14.921083 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-bfc4ae31-0d09-4dc2-bbc3-77610ff6f87a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:14.926920 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bfc4ae31-0d09-4dc2-bbc3-77610ff6f87a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:14.927349 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bfc4ae31-0d09-4dc2-bbc3-77610ff6f87a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:14.928975 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bfc4ae31-0d09-4dc2-bbc3-77610ff6f87a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:14.929393 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-bfc4ae31-0d09-4dc2-bbc3-77610ff6f87a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:14.932614 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f51cf2c2-ccfd-4eec-8f5f-16d7ec3f9cb8 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.074944 Oct 13 04:26:14.936956 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 552/1115] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:14 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:14.988805 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-bfc4ae31-0d09-4dc2-bbc3-77610ff6f87a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.072151 Oct 13 04:26:14.989470 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 564/1116] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:14 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:26:15.741465 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ce01a03d-9870-4e6f-a42b-ea22e765918e tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:15.742179 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ce01a03d-9870-4e6f-a42b-ea22e765918e tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:15.749483 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ce01a03d-9870-4e6f-a42b-ea22e765918e tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:15.749928 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ce01a03d-9870-4e6f-a42b-ea22e765918e tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:15.750742 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ce01a03d-9870-4e6f-a42b-ea22e765918e tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:15.751170 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ce01a03d-9870-4e6f-a42b-ea22e765918e tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:15.885119 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ce01a03d-9870-4e6f-a42b-ea22e765918e tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:15.893006 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ce01a03d-9870-4e6f-a42b-ea22e765918e tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1263 microversion: 2.1 time: 0.155669 Oct 13 04:26:15.893641 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 553/1117] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:26:15 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:26:15.945135 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-cc92ef32-aba9-4719-a3ca-161b182137a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:15.946146 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-cc92ef32-aba9-4719-a3ca-161b182137a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:15.952818 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cc92ef32-aba9-4719-a3ca-161b182137a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:15.953261 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cc92ef32-aba9-4719-a3ca-161b182137a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:15.954072 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cc92ef32-aba9-4719-a3ca-161b182137a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:15.954495 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cc92ef32-aba9-4719-a3ca-161b182137a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:16.003101 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-62b1dcae-c8cf-43d2-ac88-849e1b5675e9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:16.004346 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-62b1dcae-c8cf-43d2-ac88-849e1b5675e9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:16.013266 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62b1dcae-c8cf-43d2-ac88-849e1b5675e9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:16.013900 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62b1dcae-c8cf-43d2-ac88-849e1b5675e9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:16.015037 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62b1dcae-c8cf-43d2-ac88-849e1b5675e9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:16.015645 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-62b1dcae-c8cf-43d2-ac88-849e1b5675e9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:16.023205 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-cc92ef32-aba9-4719-a3ca-161b182137a6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.081979 Oct 13 04:26:16.023856 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 565/1118] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:15 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:16.081008 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-62b1dcae-c8cf-43d2-ac88-849e1b5675e9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.083813 Oct 13 04:26:16.081662 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 554/1119] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:15 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:26:16.914498 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-8280d9ce-884f-4b24-a717-02e3aca0e2ef tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:16.915449 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-8280d9ce-884f-4b24-a717-02e3aca0e2ef tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:16.925383 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8280d9ce-884f-4b24-a717-02e3aca0e2ef tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:16.925859 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8280d9ce-884f-4b24-a717-02e3aca0e2ef tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:16.926613 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8280d9ce-884f-4b24-a717-02e3aca0e2ef tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:16.927039 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8280d9ce-884f-4b24-a717-02e3aca0e2ef tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:17.035181 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-821c5597-52e5-475c-b7bf-7baace51988b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:17.036180 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-821c5597-52e5-475c-b7bf-7baace51988b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:17.042877 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-821c5597-52e5-475c-b7bf-7baace51988b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:17.043322 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-821c5597-52e5-475c-b7bf-7baace51988b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:17.044084 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-821c5597-52e5-475c-b7bf-7baace51988b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:17.044508 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-821c5597-52e5-475c-b7bf-7baace51988b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:17.053755 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-8280d9ce-884f-4b24-a717-02e3aca0e2ef tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:17.061194 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-8280d9ce-884f-4b24-a717-02e3aca0e2ef tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1263 microversion: 2.1 time: 0.153663 Oct 13 04:26:17.061781 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 566/1120] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:26:16 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:26:17.092166 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-0c0a7539-ddec-4881-93f0-0e1c58480217 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:17.093065 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-0c0a7539-ddec-4881-93f0-0e1c58480217 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:17.099109 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0c0a7539-ddec-4881-93f0-0e1c58480217 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:17.099535 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0c0a7539-ddec-4881-93f0-0e1c58480217 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:17.100286 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0c0a7539-ddec-4881-93f0-0e1c58480217 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:17.101216 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0c0a7539-ddec-4881-93f0-0e1c58480217 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:17.105101 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-821c5597-52e5-475c-b7bf-7baace51988b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.073893 Oct 13 04:26:17.105822 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 555/1121] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:17 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:17.169643 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-0c0a7539-ddec-4881-93f0-0e1c58480217 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28245 microversion: 2.1 time: 0.080310 Oct 13 04:26:17.170502 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 567/1122] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:17 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:18.083211 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-323f669e-64cb-4af1-ba0d-9255a8827ebc tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:18.084349 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-323f669e-64cb-4af1-ba0d-9255a8827ebc tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:18.095452 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-323f669e-64cb-4af1-ba0d-9255a8827ebc tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:18.096189 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-323f669e-64cb-4af1-ba0d-9255a8827ebc tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:18.096953 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-323f669e-64cb-4af1-ba0d-9255a8827ebc tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:18.097381 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-323f669e-64cb-4af1-ba0d-9255a8827ebc tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:18.116923 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6e097129-b021-4c78-9ba2-9344e8526735 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:18.117923 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6e097129-b021-4c78-9ba2-9344e8526735 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:18.124807 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6e097129-b021-4c78-9ba2-9344e8526735 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:18.125256 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6e097129-b021-4c78-9ba2-9344e8526735 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:18.126133 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6e097129-b021-4c78-9ba2-9344e8526735 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:18.126562 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6e097129-b021-4c78-9ba2-9344e8526735 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:18.224538 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-323f669e-64cb-4af1-ba0d-9255a8827ebc tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:18.235842 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-323f669e-64cb-4af1-ba0d-9255a8827ebc tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1263 microversion: 2.1 time: 0.159252 Oct 13 04:26:18.236567 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 556/1123] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:26:18 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:26:18.241187 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7302ef05-17d8-47d5-abfa-32c0a4ff47fa tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:18.242131 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7302ef05-17d8-47d5-abfa-32c0a4ff47fa tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:18.243731 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6e097129-b021-4c78-9ba2-9344e8526735 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.130709 Oct 13 04:26:18.244611 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 568/1124] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:18 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:18.249291 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7302ef05-17d8-47d5-abfa-32c0a4ff47fa tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:18.249758 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7302ef05-17d8-47d5-abfa-32c0a4ff47fa tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:18.250521 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7302ef05-17d8-47d5-abfa-32c0a4ff47fa tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:18.250981 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7302ef05-17d8-47d5-abfa-32c0a4ff47fa tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:18.341810 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7302ef05-17d8-47d5-abfa-32c0a4ff47fa tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28487 microversion: 2.1 time: 0.103419 Oct 13 04:26:18.342760 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 557/1125] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:18 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28487 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:19.254680 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-daeed6f2-fb48-4e75-bcc3-eabea8fd4e7e tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:19.255528 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-daeed6f2-fb48-4e75-bcc3-eabea8fd4e7e tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:19.257244 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b9420205-d4e9-4ff5-9550-59bae7444944 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:19.258506 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b9420205-d4e9-4ff5-9550-59bae7444944 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:19.263836 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-daeed6f2-fb48-4e75-bcc3-eabea8fd4e7e tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:19.264386 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-daeed6f2-fb48-4e75-bcc3-eabea8fd4e7e tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:19.265320 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-daeed6f2-fb48-4e75-bcc3-eabea8fd4e7e tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:19.265892 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-daeed6f2-fb48-4e75-bcc3-eabea8fd4e7e tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:19.266758 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b9420205-d4e9-4ff5-9550-59bae7444944 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:19.267328 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b9420205-d4e9-4ff5-9550-59bae7444944 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:19.268224 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b9420205-d4e9-4ff5-9550-59bae7444944 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:19.268646 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b9420205-d4e9-4ff5-9550-59bae7444944 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:19.329279 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b9420205-d4e9-4ff5-9550-59bae7444944 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.076875 Oct 13 04:26:19.333179 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 558/1126] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:19 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:19.356160 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-cae8dc70-0a81-4d59-9e1b-87f98e2e2686 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:19.357151 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-cae8dc70-0a81-4d59-9e1b-87f98e2e2686 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:19.364165 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cae8dc70-0a81-4d59-9e1b-87f98e2e2686 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:19.364610 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cae8dc70-0a81-4d59-9e1b-87f98e2e2686 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:19.365371 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cae8dc70-0a81-4d59-9e1b-87f98e2e2686 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:19.365832 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cae8dc70-0a81-4d59-9e1b-87f98e2e2686 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:19.389771 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-daeed6f2-fb48-4e75-bcc3-eabea8fd4e7e tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:19.398148 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-daeed6f2-fb48-4e75-bcc3-eabea8fd4e7e tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1263 microversion: 2.1 time: 0.148669 Oct 13 04:26:19.398733 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 569/1127] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:26:19 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:26:19.444038 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-cae8dc70-0a81-4d59-9e1b-87f98e2e2686 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28536 microversion: 2.1 time: 0.091243 Oct 13 04:26:19.445034 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 559/1128] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:19 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28536 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:20.344485 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e0d53076-0675-45dc-a2f7-32e3057f8516 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:20.345974 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e0d53076-0675-45dc-a2f7-32e3057f8516 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:20.352652 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e0d53076-0675-45dc-a2f7-32e3057f8516 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:20.353086 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e0d53076-0675-45dc-a2f7-32e3057f8516 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:20.353874 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e0d53076-0675-45dc-a2f7-32e3057f8516 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:20.354292 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e0d53076-0675-45dc-a2f7-32e3057f8516 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:20.413548 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e0d53076-0675-45dc-a2f7-32e3057f8516 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.075226 Oct 13 04:26:20.417475 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 570/1129] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:20 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:20.417695 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d4c244d3-04ad-48ec-8665-51a2f1d7bd23 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:20.417695 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d4c244d3-04ad-48ec-8665-51a2f1d7bd23 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:20.422892 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d4c244d3-04ad-48ec-8665-51a2f1d7bd23 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:20.423333 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d4c244d3-04ad-48ec-8665-51a2f1d7bd23 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:20.424091 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d4c244d3-04ad-48ec-8665-51a2f1d7bd23 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:20.424514 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d4c244d3-04ad-48ec-8665-51a2f1d7bd23 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:20.458216 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1aa42222-4a98-4ea6-bda6-b1e60a0add23 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:20.459336 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-1aa42222-4a98-4ea6-bda6-b1e60a0add23 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:20.465798 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1aa42222-4a98-4ea6-bda6-b1e60a0add23 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:20.466236 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1aa42222-4a98-4ea6-bda6-b1e60a0add23 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:20.466976 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1aa42222-4a98-4ea6-bda6-b1e60a0add23 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:20.467398 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1aa42222-4a98-4ea6-bda6-b1e60a0add23 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:20.545692 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-1aa42222-4a98-4ea6-bda6-b1e60a0add23 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.091255 Oct 13 04:26:20.546390 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 571/1130] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:20 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:26:20.552666 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-d4c244d3-04ad-48ec-8665-51a2f1d7bd23 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:20.559929 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d4c244d3-04ad-48ec-8665-51a2f1d7bd23 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1263 microversion: 2.1 time: 0.148005 Oct 13 04:26:20.560487 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 560/1131] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:26:20 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:26:21.430557 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-8edd8fc1-7059-44ef-82db-1d6aecce003e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:21.432180 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-8edd8fc1-7059-44ef-82db-1d6aecce003e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:21.443188 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8edd8fc1-7059-44ef-82db-1d6aecce003e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:21.443927 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8edd8fc1-7059-44ef-82db-1d6aecce003e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:21.445186 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8edd8fc1-7059-44ef-82db-1d6aecce003e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:21.445958 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8edd8fc1-7059-44ef-82db-1d6aecce003e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:21.558424 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-8edd8fc1-7059-44ef-82db-1d6aecce003e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 28619 microversion: 2.20 time: 0.134609 Oct 13 04:26:21.559144 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8da59a09-ffac-486f-8d1d-a51d1ade075a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:21.559716 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 572/1132] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:21 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 28619 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:21.560444 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-8da59a09-ffac-486f-8d1d-a51d1ade075a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:21.568507 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8da59a09-ffac-486f-8d1d-a51d1ade075a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:21.569089 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8da59a09-ffac-486f-8d1d-a51d1ade075a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:21.570163 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8da59a09-ffac-486f-8d1d-a51d1ade075a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:21.570640 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8da59a09-ffac-486f-8d1d-a51d1ade075a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:21.578385 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d5ae3e22-97c8-4088-aa2a-efa8c684dfec tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:21.579241 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d5ae3e22-97c8-4088-aa2a-efa8c684dfec tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:21.586434 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d5ae3e22-97c8-4088-aa2a-efa8c684dfec tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:21.586877 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d5ae3e22-97c8-4088-aa2a-efa8c684dfec tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:21.587635 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d5ae3e22-97c8-4088-aa2a-efa8c684dfec tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:21.588065 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d5ae3e22-97c8-4088-aa2a-efa8c684dfec tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:21.632059 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-8da59a09-ffac-486f-8d1d-a51d1ade075a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.077352 Oct 13 04:26:21.632709 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 561/1133] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:21 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:21.723749 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d5ae3e22-97c8-4088-aa2a-efa8c684dfec tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:21.731450 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d5ae3e22-97c8-4088-aa2a-efa8c684dfec tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1263 microversion: 2.1 time: 0.158357 Oct 13 04:26:21.732015 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 573/1134] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:26:21 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:26:22.571866 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0e828209-d1c1-490e-be1d-1db0e8594167 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:22.572859 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0e828209-d1c1-490e-be1d-1db0e8594167 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:22.579567 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0e828209-d1c1-490e-be1d-1db0e8594167 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:22.580132 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0e828209-d1c1-490e-be1d-1db0e8594167 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:22.580907 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0e828209-d1c1-490e-be1d-1db0e8594167 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:22.581334 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0e828209-d1c1-490e-be1d-1db0e8594167 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:22.587789 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-1bb65c68-fa31-426b-9c39-6ee0af0048a3 req-6ae29f82-0d55-410e-b0e6-0f330b848bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d26bf0b5-5228-42aa-89d4-3965eebb821b", "name": "network-vif-plugged", "status": "completed", "tag": "cbed6222-da96-4eeb-bab7-65423ecde122"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:22.589500 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:26:22.589500 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:26:22.598856 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-1bb65c68-fa31-426b-9c39-6ee0af0048a3 req-6ae29f82-0d55-410e-b0e6-0f330b848bef service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:22.599361 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-1bb65c68-fa31-426b-9c39-6ee0af0048a3 req-6ae29f82-0d55-410e-b0e6-0f330b848bef service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:22.611335 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-1bb65c68-fa31-426b-9c39-6ee0af0048a3 req-6ae29f82-0d55-410e-b0e6-0f330b848bef service nova] Creating event network-vif-plugged:cbed6222-da96-4eeb-bab7-65423ecde122 for instance d26bf0b5-5228-42aa-89d4-3965eebb821b on hv-cinder-81275 Oct 13 04:26:22.616253 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-1bb65c68-fa31-426b-9c39-6ee0af0048a3 req-6ae29f82-0d55-410e-b0e6-0f330b848bef service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033008 Oct 13 04:26:22.616964 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 574/1135] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:26:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:26:22.644664 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f12ab05a-efeb-4106-83c2-4bc61f6040b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:22.645732 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f12ab05a-efeb-4106-83c2-4bc61f6040b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:22.653213 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f12ab05a-efeb-4106-83c2-4bc61f6040b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:22.653678 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f12ab05a-efeb-4106-83c2-4bc61f6040b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:22.654734 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f12ab05a-efeb-4106-83c2-4bc61f6040b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:22.654894 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f12ab05a-efeb-4106-83c2-4bc61f6040b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:22.699963 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0e828209-d1c1-490e-be1d-1db0e8594167 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 29330 microversion: 2.20 time: 0.132102 Oct 13 04:26:22.700631 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 562/1136] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:22 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 29330 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:22.732173 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f12ab05a-efeb-4106-83c2-4bc61f6040b5 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.091861 Oct 13 04:26:22.732791 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 575/1137] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:22 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:26:22.748498 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-30d5aba8-5e51-4a83-b3ce-f1602a254bfa tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:22.749186 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-30d5aba8-5e51-4a83-b3ce-f1602a254bfa tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:22.756073 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30d5aba8-5e51-4a83-b3ce-f1602a254bfa tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:22.756515 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30d5aba8-5e51-4a83-b3ce-f1602a254bfa tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:22.757265 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30d5aba8-5e51-4a83-b3ce-f1602a254bfa tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:22.757704 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30d5aba8-5e51-4a83-b3ce-f1602a254bfa tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:22.906143 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-30d5aba8-5e51-4a83-b3ce-f1602a254bfa tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:22.914233 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-30d5aba8-5e51-4a83-b3ce-f1602a254bfa tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1263 microversion: 2.1 time: 0.169248 Oct 13 04:26:22.914980 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 563/1138] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:26:22 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1263 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:26:23.717632 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2119cce5-6165-4afd-8eef-a5d8640797c3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:23.719259 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-2119cce5-6165-4afd-8eef-a5d8640797c3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:23.730985 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2119cce5-6165-4afd-8eef-a5d8640797c3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:23.731719 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2119cce5-6165-4afd-8eef-a5d8640797c3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:23.732958 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2119cce5-6165-4afd-8eef-a5d8640797c3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:23.733678 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2119cce5-6165-4afd-8eef-a5d8640797c3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:23.743986 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d09d15cf-bbf8-48b2-b34f-829040fcd5cc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:23.744960 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d09d15cf-bbf8-48b2-b34f-829040fcd5cc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:23.751075 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d09d15cf-bbf8-48b2-b34f-829040fcd5cc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:23.751520 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d09d15cf-bbf8-48b2-b34f-829040fcd5cc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:23.752289 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d09d15cf-bbf8-48b2-b34f-829040fcd5cc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:23.752716 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d09d15cf-bbf8-48b2-b34f-829040fcd5cc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:23.858499 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-2119cce5-6165-4afd-8eef-a5d8640797c3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 31258 microversion: 2.20 time: 0.147619 Oct 13 04:26:23.859436 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 576/1139] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:23 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 31258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:23.866468 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d09d15cf-bbf8-48b2-b34f-829040fcd5cc tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.125628 Oct 13 04:26:23.867495 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 564/1140] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:23 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:23.936243 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a54cfd0b-bb01-4ff0-ac84-763ab90f21f1 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:23.937360 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a54cfd0b-bb01-4ff0-ac84-763ab90f21f1 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:23.944930 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a54cfd0b-bb01-4ff0-ac84-763ab90f21f1 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:23.945366 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a54cfd0b-bb01-4ff0-ac84-763ab90f21f1 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:23.946169 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a54cfd0b-bb01-4ff0-ac84-763ab90f21f1 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:23.946585 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a54cfd0b-bb01-4ff0-ac84-763ab90f21f1 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:24.089827 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a54cfd0b-bb01-4ff0-ac84-763ab90f21f1 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:24.098049 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a54cfd0b-bb01-4ff0-ac84-763ab90f21f1 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1263 microversion: 2.1 time: 0.168479 Oct 13 04:26:24.098609 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 577/1141] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:26:23 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:26:24.878014 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1f404da6-6024-42ef-a62a-a22e6c127577 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:24.878999 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1f404da6-6024-42ef-a62a-a22e6c127577 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:24.882059 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5a23d664-92b1-462a-932c-9c735a7b5d44 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:24.883101 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5a23d664-92b1-462a-932c-9c735a7b5d44 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:24.886753 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1f404da6-6024-42ef-a62a-a22e6c127577 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:24.887240 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1f404da6-6024-42ef-a62a-a22e6c127577 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:24.888053 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1f404da6-6024-42ef-a62a-a22e6c127577 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:24.888510 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1f404da6-6024-42ef-a62a-a22e6c127577 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:24.889882 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5a23d664-92b1-462a-932c-9c735a7b5d44 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:24.890355 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5a23d664-92b1-462a-932c-9c735a7b5d44 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:24.891191 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5a23d664-92b1-462a-932c-9c735a7b5d44 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:24.891678 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5a23d664-92b1-462a-932c-9c735a7b5d44 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:24.962651 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5a23d664-92b1-462a-932c-9c735a7b5d44 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.084649 Oct 13 04:26:24.963259 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 578/1142] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:24 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:24.978331 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1f404da6-6024-42ef-a62a-a22e6c127577 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 32804 microversion: 2.20 time: 0.106748 Oct 13 04:26:24.978958 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 565/1143] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:24 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 32804 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:25.119392 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b2e9ac08-b84f-4a30-be84-e5577abeddc8 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:25.120515 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b2e9ac08-b84f-4a30-be84-e5577abeddc8 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:25.131835 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b2e9ac08-b84f-4a30-be84-e5577abeddc8 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:25.132449 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b2e9ac08-b84f-4a30-be84-e5577abeddc8 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:25.133675 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b2e9ac08-b84f-4a30-be84-e5577abeddc8 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:25.134410 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b2e9ac08-b84f-4a30-be84-e5577abeddc8 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:25.262776 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b2e9ac08-b84f-4a30-be84-e5577abeddc8 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:25.270541 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b2e9ac08-b84f-4a30-be84-e5577abeddc8 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1451 microversion: 2.1 time: 0.157950 Oct 13 04:26:25.271138 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 579/1144] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:26:25 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:26:25.290264 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-484b6283-1dc8-4b8a-966d-d9e76feb401b tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:25.291130 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-484b6283-1dc8-4b8a-966d-d9e76feb401b tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:25.300412 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-484b6283-1dc8-4b8a-966d-d9e76feb401b tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:25.300880 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-484b6283-1dc8-4b8a-966d-d9e76feb401b tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:25.301792 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-484b6283-1dc8-4b8a-966d-d9e76feb401b tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:25.302223 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-484b6283-1dc8-4b8a-966d-d9e76feb401b tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:25.439929 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-484b6283-1dc8-4b8a-966d-d9e76feb401b tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:25.447687 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-484b6283-1dc8-4b8a-966d-d9e76feb401b tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1451 microversion: 2.1 time: 0.164023 Oct 13 04:26:25.448260 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 566/1145] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:26:25 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:26:25.974532 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-96f2a432-fc8f-420a-b9bd-3d91f7c6cf3f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:25.975449 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-96f2a432-fc8f-420a-b9bd-3d91f7c6cf3f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:25.981389 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-96f2a432-fc8f-420a-b9bd-3d91f7c6cf3f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:25.981862 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-96f2a432-fc8f-420a-b9bd-3d91f7c6cf3f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:25.982612 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-96f2a432-fc8f-420a-b9bd-3d91f7c6cf3f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:25.983032 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-96f2a432-fc8f-420a-b9bd-3d91f7c6cf3f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:25.990195 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-14e471ed-b616-4818-8cdc-6d35530335ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:25.991921 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-14e471ed-b616-4818-8cdc-6d35530335ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:25.998122 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-14e471ed-b616-4818-8cdc-6d35530335ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:25.998561 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-14e471ed-b616-4818-8cdc-6d35530335ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:25.999336 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-14e471ed-b616-4818-8cdc-6d35530335ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:25.999764 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-14e471ed-b616-4818-8cdc-6d35530335ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:26.051053 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-96f2a432-fc8f-420a-b9bd-3d91f7c6cf3f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.080052 Oct 13 04:26:26.051983 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 580/1146] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:25 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:26.070849 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-14e471ed-b616-4818-8cdc-6d35530335ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 33712 microversion: 2.20 time: 0.084154 Oct 13 04:26:26.071543 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 567/1147] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:25 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 33712 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:27.063745 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9963a907-4e94-4412-a62d-397da5991be3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:27.064914 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9963a907-4e94-4412-a62d-397da5991be3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:27.071887 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9963a907-4e94-4412-a62d-397da5991be3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:27.072395 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9963a907-4e94-4412-a62d-397da5991be3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:27.073291 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9963a907-4e94-4412-a62d-397da5991be3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:27.073796 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9963a907-4e94-4412-a62d-397da5991be3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:27.083758 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0a71011b-2568-4aad-a11a-17dd4dc1d5cb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:27.084738 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0a71011b-2568-4aad-a11a-17dd4dc1d5cb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:27.091595 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0a71011b-2568-4aad-a11a-17dd4dc1d5cb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:27.092082 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0a71011b-2568-4aad-a11a-17dd4dc1d5cb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:27.092855 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0a71011b-2568-4aad-a11a-17dd4dc1d5cb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:27.093249 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0a71011b-2568-4aad-a11a-17dd4dc1d5cb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:27.135295 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9963a907-4e94-4412-a62d-397da5991be3 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.075603 Oct 13 04:26:27.135923 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 581/1148] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:27 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:27.163287 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0a71011b-2568-4aad-a11a-17dd4dc1d5cb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 34931 microversion: 2.20 time: 0.083435 Oct 13 04:26:27.167493 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 568/1149] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:27 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 34931 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:27.260812 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-ea816051-e556-44d5-8282-57a8bb197768 req-81c489e3-62d4-466f-a421-71112d634621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d26bf0b5-5228-42aa-89d4-3965eebb821b", "tag": "cbed6222-da96-4eeb-bab7-65423ecde122"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:27.262301 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:26:27.262301 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:26:27.269752 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-ea816051-e556-44d5-8282-57a8bb197768 req-81c489e3-62d4-466f-a421-71112d634621 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:27.270176 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-ea816051-e556-44d5-8282-57a8bb197768 req-81c489e3-62d4-466f-a421-71112d634621 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:27.281150 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-ea816051-e556-44d5-8282-57a8bb197768 req-81c489e3-62d4-466f-a421-71112d634621 service nova] Creating event network-changed:cbed6222-da96-4eeb-bab7-65423ecde122 for instance d26bf0b5-5228-42aa-89d4-3965eebb821b on hv-cinder-81275 Oct 13 04:26:27.286182 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-ea816051-e556-44d5-8282-57a8bb197768 req-81c489e3-62d4-466f-a421-71112d634621 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029619 Oct 13 04:26:27.286784 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 582/1150] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:26:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:26:28.147934 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e219b946-b9ca-483f-96d6-e9e3b01e8c55 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:28.148937 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e219b946-b9ca-483f-96d6-e9e3b01e8c55 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:28.156302 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e219b946-b9ca-483f-96d6-e9e3b01e8c55 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:28.156741 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e219b946-b9ca-483f-96d6-e9e3b01e8c55 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:28.157513 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e219b946-b9ca-483f-96d6-e9e3b01e8c55 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:28.158015 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e219b946-b9ca-483f-96d6-e9e3b01e8c55 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:28.175861 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a9c04f6d-a57d-48d6-9df7-08c6fa5be857 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:28.176862 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a9c04f6d-a57d-48d6-9df7-08c6fa5be857 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:28.183108 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a9c04f6d-a57d-48d6-9df7-08c6fa5be857 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:28.183545 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a9c04f6d-a57d-48d6-9df7-08c6fa5be857 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:28.184328 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a9c04f6d-a57d-48d6-9df7-08c6fa5be857 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:28.184824 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a9c04f6d-a57d-48d6-9df7-08c6fa5be857 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:28.218585 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e219b946-b9ca-483f-96d6-e9e3b01e8c55 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.074599 Oct 13 04:26:28.219396 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 569/1151] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:28 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:26:28.258291 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a9c04f6d-a57d-48d6-9df7-08c6fa5be857 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 36115 microversion: 2.20 time: 0.086381 Oct 13 04:26:28.258920 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 583/1152] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:28 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 36115 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:29.235818 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ea30ba83-4daf-4438-a98f-788b5281d220 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:29.237446 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ea30ba83-4daf-4438-a98f-788b5281d220 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:29.248204 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ea30ba83-4daf-4438-a98f-788b5281d220 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:29.248931 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ea30ba83-4daf-4438-a98f-788b5281d220 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:29.250237 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ea30ba83-4daf-4438-a98f-788b5281d220 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:29.250982 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ea30ba83-4daf-4438-a98f-788b5281d220 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:29.270870 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-6a5d9891-dae1-449c-b79e-e21479475b92 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:29.271895 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-6a5d9891-dae1-449c-b79e-e21479475b92 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:29.280085 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6a5d9891-dae1-449c-b79e-e21479475b92 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:29.280698 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6a5d9891-dae1-449c-b79e-e21479475b92 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:29.281543 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6a5d9891-dae1-449c-b79e-e21479475b92 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:29.282023 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-6a5d9891-dae1-449c-b79e-e21479475b92 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:29.312294 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ea30ba83-4daf-4438-a98f-788b5281d220 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.083655 Oct 13 04:26:29.315306 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 570/1153] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:29 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:29.358851 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-6a5d9891-dae1-449c-b79e-e21479475b92 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 37672 microversion: 2.20 time: 0.091522 Oct 13 04:26:29.359812 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 584/1154] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:29 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 37672 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:30.329730 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-498ae774-0b4d-4c67-90a4-241e73a77b59 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:30.330901 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-498ae774-0b4d-4c67-90a4-241e73a77b59 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:30.338763 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-498ae774-0b4d-4c67-90a4-241e73a77b59 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:30.339275 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-498ae774-0b4d-4c67-90a4-241e73a77b59 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:30.340155 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-498ae774-0b4d-4c67-90a4-241e73a77b59 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:30.340653 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-498ae774-0b4d-4c67-90a4-241e73a77b59 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:30.374854 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1e14f195-9e8a-44a5-b208-6806b793b42a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:30.376068 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-1e14f195-9e8a-44a5-b208-6806b793b42a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:30.384140 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1e14f195-9e8a-44a5-b208-6806b793b42a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:30.384566 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1e14f195-9e8a-44a5-b208-6806b793b42a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:30.385339 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1e14f195-9e8a-44a5-b208-6806b793b42a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:30.385788 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1e14f195-9e8a-44a5-b208-6806b793b42a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:30.408340 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-498ae774-0b4d-4c67-90a4-241e73a77b59 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.085494 Oct 13 04:26:30.408991 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 571/1155] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:30 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:30.461817 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-1e14f195-9e8a-44a5-b208-6806b793b42a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 38169 microversion: 2.20 time: 0.092244 Oct 13 04:26:30.462810 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 585/1156] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:30 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 38169 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:31.425257 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e0ae15d6-0752-4742-b516-063e0463bfd9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:31.426895 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e0ae15d6-0752-4742-b516-063e0463bfd9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:31.437850 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e0ae15d6-0752-4742-b516-063e0463bfd9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:31.438602 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e0ae15d6-0752-4742-b516-063e0463bfd9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:31.439615 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e0ae15d6-0752-4742-b516-063e0463bfd9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:31.440043 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e0ae15d6-0752-4742-b516-063e0463bfd9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:31.477977 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-01a880a8-d96e-4c8f-9fb4-adf33424f033 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:31.478901 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-01a880a8-d96e-4c8f-9fb4-adf33424f033 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:31.487394 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-01a880a8-d96e-4c8f-9fb4-adf33424f033 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:31.488154 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-01a880a8-d96e-4c8f-9fb4-adf33424f033 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:31.489414 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-01a880a8-d96e-4c8f-9fb4-adf33424f033 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:31.490076 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-01a880a8-d96e-4c8f-9fb4-adf33424f033 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:31.501921 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e0ae15d6-0752-4742-b516-063e0463bfd9 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.083158 Oct 13 04:26:31.505986 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 572/1157] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:31 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:31.557402 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-01a880a8-d96e-4c8f-9fb4-adf33424f033 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 38169 microversion: 2.20 time: 0.083486 Oct 13 04:26:31.558081 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 586/1158] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:31 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 38169 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:32.518193 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d4573b31-37e9-4b71-ad9d-30bfbd41ffb4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:32.519210 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d4573b31-37e9-4b71-ad9d-30bfbd41ffb4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:32.526190 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d4573b31-37e9-4b71-ad9d-30bfbd41ffb4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:32.526991 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d4573b31-37e9-4b71-ad9d-30bfbd41ffb4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:32.527720 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d4573b31-37e9-4b71-ad9d-30bfbd41ffb4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:32.528139 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d4573b31-37e9-4b71-ad9d-30bfbd41ffb4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:32.573947 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-901d4cd3-3879-49e5-a9ed-354e0c39b39b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:32.575166 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-901d4cd3-3879-49e5-a9ed-354e0c39b39b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:32.583667 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-901d4cd3-3879-49e5-a9ed-354e0c39b39b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:32.584108 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-901d4cd3-3879-49e5-a9ed-354e0c39b39b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:32.584859 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-901d4cd3-3879-49e5-a9ed-354e0c39b39b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:32.585282 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-901d4cd3-3879-49e5-a9ed-354e0c39b39b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:32.596064 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d4573b31-37e9-4b71-ad9d-30bfbd41ffb4 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.084066 Oct 13 04:26:32.599147 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 573/1159] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:32 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:32.649972 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-901d4cd3-3879-49e5-a9ed-354e0c39b39b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 38169 microversion: 2.20 time: 0.081998 Oct 13 04:26:32.650850 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 587/1160] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:32 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 38169 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:33.608526 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-465add5e-43b0-4b43-9d18-664c650b934f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:33.610134 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-465add5e-43b0-4b43-9d18-664c650b934f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:33.619058 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-465add5e-43b0-4b43-9d18-664c650b934f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:33.619733 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-465add5e-43b0-4b43-9d18-664c650b934f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:33.620889 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-465add5e-43b0-4b43-9d18-664c650b934f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:33.621533 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-465add5e-43b0-4b43-9d18-664c650b934f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:33.665193 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ee87c618-2027-4985-b99b-9e0bbf03e1b5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:33.666218 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ee87c618-2027-4985-b99b-9e0bbf03e1b5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:33.673125 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ee87c618-2027-4985-b99b-9e0bbf03e1b5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:33.673564 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ee87c618-2027-4985-b99b-9e0bbf03e1b5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:33.674353 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ee87c618-2027-4985-b99b-9e0bbf03e1b5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:33.674774 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ee87c618-2027-4985-b99b-9e0bbf03e1b5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:33.693943 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-465add5e-43b0-4b43-9d18-664c650b934f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.089678 Oct 13 04:26:33.694630 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 574/1161] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:33 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:33.747070 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ee87c618-2027-4985-b99b-9e0bbf03e1b5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 38182 microversion: 2.20 time: 0.085932 Oct 13 04:26:33.747691 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 588/1162] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:33 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 38182 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:34.709524 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-30fc962d-aafa-43a8-af01-2f7aa2c4eb53 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:34.710726 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-30fc962d-aafa-43a8-af01-2f7aa2c4eb53 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:34.718640 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30fc962d-aafa-43a8-af01-2f7aa2c4eb53 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:34.719150 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30fc962d-aafa-43a8-af01-2f7aa2c4eb53 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:34.720029 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30fc962d-aafa-43a8-af01-2f7aa2c4eb53 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:34.720539 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30fc962d-aafa-43a8-af01-2f7aa2c4eb53 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:34.761471 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ccee7751-871d-4d82-ab6d-3bddaca9de33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:34.762505 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ccee7751-871d-4d82-ab6d-3bddaca9de33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:34.769623 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ccee7751-871d-4d82-ab6d-3bddaca9de33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:34.770066 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ccee7751-871d-4d82-ab6d-3bddaca9de33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:34.770831 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ccee7751-871d-4d82-ab6d-3bddaca9de33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:34.771255 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ccee7751-871d-4d82-ab6d-3bddaca9de33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:34.785530 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-30fc962d-aafa-43a8-af01-2f7aa2c4eb53 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.081268 Oct 13 04:26:34.786182 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 575/1163] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:34 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:34.850933 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ccee7751-871d-4d82-ab6d-3bddaca9de33 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 200 len: 38308 microversion: 2.20 time: 0.093066 Oct 13 04:26:34.851911 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 589/1164] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:34 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 38308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:26:34.866143 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-cc0c357f-0edb-40b8-90a9-540577aa007d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:34.866707 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-cc0c357f-0edb-40b8-90a9-540577aa007d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:34.873410 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cc0c357f-0edb-40b8-90a9-540577aa007d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:34.873872 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cc0c357f-0edb-40b8-90a9-540577aa007d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:34.874625 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cc0c357f-0edb-40b8-90a9-540577aa007d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:34.875042 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cc0c357f-0edb-40b8-90a9-540577aa007d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:34.897966 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-cc0c357f-0edb-40b8-90a9-540577aa007d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/ips" status: 200 len: 151 microversion: 2.20 time: 0.036058 Oct 13 04:26:34.898503 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 576/1165] 10.222.0.55 () {60 vars in 1288 bytes} [Wed Oct 13 04:26:34 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:35.803111 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-10684e39-8cf6-4977-9836-f24ad5ea441c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:35.804010 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-10684e39-8cf6-4977-9836-f24ad5ea441c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:35.810962 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-10684e39-8cf6-4977-9836-f24ad5ea441c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:35.811403 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-10684e39-8cf6-4977-9836-f24ad5ea441c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:35.812159 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-10684e39-8cf6-4977-9836-f24ad5ea441c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:35.812583 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-10684e39-8cf6-4977-9836-f24ad5ea441c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:35.884570 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-10684e39-8cf6-4977-9836-f24ad5ea441c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.087447 Oct 13 04:26:35.885564 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 590/1166] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:35 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:36.903316 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4c3fa2a2-be19-43c8-bff2-96d175633c2c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:36.904583 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4c3fa2a2-be19-43c8-bff2-96d175633c2c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:36.913404 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4c3fa2a2-be19-43c8-bff2-96d175633c2c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:36.913884 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4c3fa2a2-be19-43c8-bff2-96d175633c2c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:36.914647 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4c3fa2a2-be19-43c8-bff2-96d175633c2c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:36.915074 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4c3fa2a2-be19-43c8-bff2-96d175633c2c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:36.976958 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4c3fa2a2-be19-43c8-bff2-96d175633c2c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.080642 Oct 13 04:26:36.977582 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 577/1167] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:36 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:37.128022 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c8dbaa39-8def-4e5c-ab58-ae11bd23beb9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:37.128674 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c8dbaa39-8def-4e5c-ab58-ae11bd23beb9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:37.136355 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c8dbaa39-8def-4e5c-ab58-ae11bd23beb9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:37.136945 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c8dbaa39-8def-4e5c-ab58-ae11bd23beb9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:37.137733 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c8dbaa39-8def-4e5c-ab58-ae11bd23beb9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:37.138208 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c8dbaa39-8def-4e5c-ab58-ae11bd23beb9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:37.162760 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.objects.instance [None req-c8dbaa39-8def-4e5c-ab58-ae11bd23beb9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lazy-loading 'flavor' on Instance uuid 7a6451d1-6399-4efc-8b6a-0e57ee0610b8 {{(pid=108260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:26:37.428414 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c8dbaa39-8def-4e5c-ab58-ae11bd23beb9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 202 len: 0 microversion: 2.20 time: 0.304891 Oct 13 04:26:37.429222 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 591/1168] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:26:37 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:26:37.438821 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-43c4fab3-fc58-4c11-abf2-779f334d65ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:37.439621 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-43c4fab3-fc58-4c11-abf2-779f334d65ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:37.446730 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-43c4fab3-fc58-4c11-abf2-779f334d65ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:37.447162 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-43c4fab3-fc58-4c11-abf2-779f334d65ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:37.447928 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-43c4fab3-fc58-4c11-abf2-779f334d65ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:37.448351 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-43c4fab3-fc58-4c11-abf2-779f334d65ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:37.572161 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-43c4fab3-fc58-4c11-abf2-779f334d65ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:37.580470 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-43c4fab3-fc58-4c11-abf2-779f334d65ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:37.582042 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-43c4fab3-fc58-4c11-abf2-779f334d65ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:37.583172 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-43c4fab3-fc58-4c11-abf2-779f334d65ed tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1720 microversion: 2.20 time: 0.149493 Oct 13 04:26:37.583723 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 578/1169] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:37 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:37.992855 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f1dc64e7-ed17-4821-a2d4-803a676cd321 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:37.994511 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f1dc64e7-ed17-4821-a2d4-803a676cd321 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:38.005108 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f1dc64e7-ed17-4821-a2d4-803a676cd321 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:38.005906 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f1dc64e7-ed17-4821-a2d4-803a676cd321 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:38.007024 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f1dc64e7-ed17-4821-a2d4-803a676cd321 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:38.007450 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f1dc64e7-ed17-4821-a2d4-803a676cd321 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:38.080556 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f1dc64e7-ed17-4821-a2d4-803a676cd321 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.094039 Oct 13 04:26:38.081600 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 592/1170] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:37 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:38.604061 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-827f8745-231b-4d3b-b72c-a4216dcd53ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:38.604790 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-827f8745-231b-4d3b-b72c-a4216dcd53ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:38.613059 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-827f8745-231b-4d3b-b72c-a4216dcd53ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:38.613630 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-827f8745-231b-4d3b-b72c-a4216dcd53ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:38.614597 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-827f8745-231b-4d3b-b72c-a4216dcd53ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:38.615122 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-827f8745-231b-4d3b-b72c-a4216dcd53ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:38.744225 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-827f8745-231b-4d3b-b72c-a4216dcd53ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:38.755951 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-827f8745-231b-4d3b-b72c-a4216dcd53ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:38.757571 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-827f8745-231b-4d3b-b72c-a4216dcd53ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:38.758740 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-827f8745-231b-4d3b-b72c-a4216dcd53ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1720 microversion: 2.20 time: 0.159595 Oct 13 04:26:38.759303 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 579/1171] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:38 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:39.095697 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2246deb1-e79f-478d-b6fa-7df7e8ae097d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:39.096625 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-2246deb1-e79f-478d-b6fa-7df7e8ae097d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:39.103470 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2246deb1-e79f-478d-b6fa-7df7e8ae097d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:39.103902 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2246deb1-e79f-478d-b6fa-7df7e8ae097d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:39.104646 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2246deb1-e79f-478d-b6fa-7df7e8ae097d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:39.105065 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2246deb1-e79f-478d-b6fa-7df7e8ae097d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:39.180461 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-2246deb1-e79f-478d-b6fa-7df7e8ae097d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.088185 Oct 13 04:26:39.181481 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 593/1172] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:39 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:39.782150 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4f94d643-b75a-4d42-a26a-cf44953adbea tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:39.783065 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4f94d643-b75a-4d42-a26a-cf44953adbea tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:39.791169 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4f94d643-b75a-4d42-a26a-cf44953adbea tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:39.791610 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4f94d643-b75a-4d42-a26a-cf44953adbea tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:39.792354 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4f94d643-b75a-4d42-a26a-cf44953adbea tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:39.792779 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4f94d643-b75a-4d42-a26a-cf44953adbea tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:39.926952 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-4f94d643-b75a-4d42-a26a-cf44953adbea tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:39.935027 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-4f94d643-b75a-4d42-a26a-cf44953adbea tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:39.936531 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-4f94d643-b75a-4d42-a26a-cf44953adbea tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:39.937741 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4f94d643-b75a-4d42-a26a-cf44953adbea tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1720 microversion: 2.20 time: 0.162296 Oct 13 04:26:39.938297 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 580/1173] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:39 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:40.200245 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-42b09a37-0347-4248-8cc9-13b61d6bc016 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:40.201897 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-42b09a37-0347-4248-8cc9-13b61d6bc016 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:40.211640 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-42b09a37-0347-4248-8cc9-13b61d6bc016 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:40.212076 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-42b09a37-0347-4248-8cc9-13b61d6bc016 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:40.212833 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-42b09a37-0347-4248-8cc9-13b61d6bc016 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:40.213258 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-42b09a37-0347-4248-8cc9-13b61d6bc016 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:40.280897 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-42b09a37-0347-4248-8cc9-13b61d6bc016 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.087510 Oct 13 04:26:40.281525 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 594/1174] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:40 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:40.959907 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-98de4e32-2556-495a-ae22-7e7c3f450348 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:40.960515 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-98de4e32-2556-495a-ae22-7e7c3f450348 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:40.967420 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-98de4e32-2556-495a-ae22-7e7c3f450348 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:40.967860 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-98de4e32-2556-495a-ae22-7e7c3f450348 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:40.968619 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-98de4e32-2556-495a-ae22-7e7c3f450348 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:40.969043 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-98de4e32-2556-495a-ae22-7e7c3f450348 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:41.094593 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-98de4e32-2556-495a-ae22-7e7c3f450348 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:41.102415 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-98de4e32-2556-495a-ae22-7e7c3f450348 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:41.103900 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-98de4e32-2556-495a-ae22-7e7c3f450348 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:41.105079 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-98de4e32-2556-495a-ae22-7e7c3f450348 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1720 microversion: 2.20 time: 0.151366 Oct 13 04:26:41.105648 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 581/1175] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:40 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:41.297658 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5af45654-ffff-486e-8bfa-0ee5944f8604 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:41.299375 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5af45654-ffff-486e-8bfa-0ee5944f8604 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:41.310278 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5af45654-ffff-486e-8bfa-0ee5944f8604 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:41.311038 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5af45654-ffff-486e-8bfa-0ee5944f8604 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:41.312266 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5af45654-ffff-486e-8bfa-0ee5944f8604 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:41.312966 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5af45654-ffff-486e-8bfa-0ee5944f8604 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:41.384435 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5af45654-ffff-486e-8bfa-0ee5944f8604 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.093385 Oct 13 04:26:41.385071 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 595/1176] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:41 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:42.123777 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ea2c209a-2df1-4a4f-8b2d-7fbe4264db0a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:42.124416 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ea2c209a-2df1-4a4f-8b2d-7fbe4264db0a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:42.130701 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ea2c209a-2df1-4a4f-8b2d-7fbe4264db0a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:42.131178 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ea2c209a-2df1-4a4f-8b2d-7fbe4264db0a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:42.131936 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ea2c209a-2df1-4a4f-8b2d-7fbe4264db0a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:42.132352 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ea2c209a-2df1-4a4f-8b2d-7fbe4264db0a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:42.258993 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ea2c209a-2df1-4a4f-8b2d-7fbe4264db0a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:42.267135 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ea2c209a-2df1-4a4f-8b2d-7fbe4264db0a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:42.268621 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ea2c209a-2df1-4a4f-8b2d-7fbe4264db0a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:42.269767 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ea2c209a-2df1-4a4f-8b2d-7fbe4264db0a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1720 microversion: 2.20 time: 0.150093 Oct 13 04:26:42.270324 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 582/1177] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:42 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:42.396745 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ad9a19e0-38ec-4f8e-a738-ea66eaea22cf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:42.397795 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ad9a19e0-38ec-4f8e-a738-ea66eaea22cf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:42.404990 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ad9a19e0-38ec-4f8e-a738-ea66eaea22cf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:42.405438 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ad9a19e0-38ec-4f8e-a738-ea66eaea22cf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:42.406238 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ad9a19e0-38ec-4f8e-a738-ea66eaea22cf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:42.406660 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ad9a19e0-38ec-4f8e-a738-ea66eaea22cf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:42.466262 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ad9a19e0-38ec-4f8e-a738-ea66eaea22cf tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.073301 Oct 13 04:26:42.467099 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 596/1178] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:42 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:43.288582 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-45d85ecc-dda3-4ee8-8f9f-89896f44ec06 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:43.289176 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-45d85ecc-dda3-4ee8-8f9f-89896f44ec06 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:43.295527 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-45d85ecc-dda3-4ee8-8f9f-89896f44ec06 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:43.295960 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-45d85ecc-dda3-4ee8-8f9f-89896f44ec06 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:43.296704 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-45d85ecc-dda3-4ee8-8f9f-89896f44ec06 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:43.297119 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-45d85ecc-dda3-4ee8-8f9f-89896f44ec06 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:43.440121 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-45d85ecc-dda3-4ee8-8f9f-89896f44ec06 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:43.452467 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-45d85ecc-dda3-4ee8-8f9f-89896f44ec06 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:43.454613 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-45d85ecc-dda3-4ee8-8f9f-89896f44ec06 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:43.456372 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-45d85ecc-dda3-4ee8-8f9f-89896f44ec06 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1720 microversion: 2.20 time: 0.171361 Oct 13 04:26:43.457122 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 583/1179] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:43 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:43.480131 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-418ce572-e54c-4c11-bca3-5a034cc9991f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:43.481047 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-418ce572-e54c-4c11-bca3-5a034cc9991f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:43.487650 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-418ce572-e54c-4c11-bca3-5a034cc9991f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:43.488084 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-418ce572-e54c-4c11-bca3-5a034cc9991f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:43.488829 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-418ce572-e54c-4c11-bca3-5a034cc9991f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:43.489251 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-418ce572-e54c-4c11-bca3-5a034cc9991f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:43.548299 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-418ce572-e54c-4c11-bca3-5a034cc9991f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.072189 Oct 13 04:26:43.548916 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 597/1180] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:43 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:44.476794 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b4fd21f9-2ad0-45a5-8aa1-46c526a4b480 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:44.477702 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b4fd21f9-2ad0-45a5-8aa1-46c526a4b480 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:44.486418 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b4fd21f9-2ad0-45a5-8aa1-46c526a4b480 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:44.486863 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b4fd21f9-2ad0-45a5-8aa1-46c526a4b480 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:44.487624 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b4fd21f9-2ad0-45a5-8aa1-46c526a4b480 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:44.488095 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b4fd21f9-2ad0-45a5-8aa1-46c526a4b480 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:44.560843 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f4449fb1-919c-4f20-a85e-3062b183031b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:44.561869 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f4449fb1-919c-4f20-a85e-3062b183031b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:44.568628 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f4449fb1-919c-4f20-a85e-3062b183031b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:44.569043 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f4449fb1-919c-4f20-a85e-3062b183031b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:44.569868 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f4449fb1-919c-4f20-a85e-3062b183031b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:44.570291 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f4449fb1-919c-4f20-a85e-3062b183031b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:44.612489 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b4fd21f9-2ad0-45a5-8aa1-46c526a4b480 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:44.620906 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b4fd21f9-2ad0-45a5-8aa1-46c526a4b480 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:44.622456 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b4fd21f9-2ad0-45a5-8aa1-46c526a4b480 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:44.623599 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b4fd21f9-2ad0-45a5-8aa1-46c526a4b480 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1720 microversion: 2.20 time: 0.152331 Oct 13 04:26:44.624155 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 584/1181] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:44 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:44.631757 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f4449fb1-919c-4f20-a85e-3062b183031b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.074971 Oct 13 04:26:44.632409 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 598/1182] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:44 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:26:45.642311 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5da48ffc-e0cb-4a27-8216-24ba8ef21943 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:45.642898 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-5da48ffc-e0cb-4a27-8216-24ba8ef21943 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:45.648750 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-fb081ef1-d241-4d93-b2e5-35428a988e0d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:45.649345 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5da48ffc-e0cb-4a27-8216-24ba8ef21943 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:45.649737 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-fb081ef1-d241-4d93-b2e5-35428a988e0d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:45.649904 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5da48ffc-e0cb-4a27-8216-24ba8ef21943 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:45.650601 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5da48ffc-e0cb-4a27-8216-24ba8ef21943 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:45.651020 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5da48ffc-e0cb-4a27-8216-24ba8ef21943 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:45.657175 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fb081ef1-d241-4d93-b2e5-35428a988e0d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:45.657638 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fb081ef1-d241-4d93-b2e5-35428a988e0d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:45.658400 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fb081ef1-d241-4d93-b2e5-35428a988e0d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:45.658822 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fb081ef1-d241-4d93-b2e5-35428a988e0d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:45.735507 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-fb081ef1-d241-4d93-b2e5-35428a988e0d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.090652 Oct 13 04:26:45.736141 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 599/1183] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:45 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:45.820407 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-5da48ffc-e0cb-4a27-8216-24ba8ef21943 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:45.831224 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-5da48ffc-e0cb-4a27-8216-24ba8ef21943 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:45.833119 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-5da48ffc-e0cb-4a27-8216-24ba8ef21943 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:45.834298 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-5da48ffc-e0cb-4a27-8216-24ba8ef21943 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1720 microversion: 2.20 time: 0.196107 Oct 13 04:26:45.834862 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 585/1184] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:45 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:46.752503 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ef456fe1-7065-4591-b75e-4b3cfb6f3e5b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:46.754131 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ef456fe1-7065-4591-b75e-4b3cfb6f3e5b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:46.764943 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ef456fe1-7065-4591-b75e-4b3cfb6f3e5b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:46.765687 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ef456fe1-7065-4591-b75e-4b3cfb6f3e5b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:46.767046 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ef456fe1-7065-4591-b75e-4b3cfb6f3e5b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:46.767750 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ef456fe1-7065-4591-b75e-4b3cfb6f3e5b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:46.853835 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ef456fe1-7065-4591-b75e-4b3cfb6f3e5b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.107444 Oct 13 04:26:46.854412 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 600/1185] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:46 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:46.855069 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1801aee8-afb0-49ad-b524-322ce64e955d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:46.856005 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1801aee8-afb0-49ad-b524-322ce64e955d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:46.862449 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1801aee8-afb0-49ad-b524-322ce64e955d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:46.862888 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1801aee8-afb0-49ad-b524-322ce64e955d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:46.863647 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1801aee8-afb0-49ad-b524-322ce64e955d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:46.864066 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1801aee8-afb0-49ad-b524-322ce64e955d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:46.999906 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1801aee8-afb0-49ad-b524-322ce64e955d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:47.010441 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1801aee8-afb0-49ad-b524-322ce64e955d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:47.011926 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1801aee8-afb0-49ad-b524-322ce64e955d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:47.013092 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1801aee8-afb0-49ad-b524-322ce64e955d tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1720 microversion: 2.20 time: 0.163194 Oct 13 04:26:47.013650 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 586/1186] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:46 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:47.871617 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-868ae2e6-df8a-4d79-89f4-57e15d8df0ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:47.873112 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-868ae2e6-df8a-4d79-89f4-57e15d8df0ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:47.883302 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-868ae2e6-df8a-4d79-89f4-57e15d8df0ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:47.883737 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-868ae2e6-df8a-4d79-89f4-57e15d8df0ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:47.884493 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-868ae2e6-df8a-4d79-89f4-57e15d8df0ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:47.884919 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-868ae2e6-df8a-4d79-89f4-57e15d8df0ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:47.950000 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-868ae2e6-df8a-4d79-89f4-57e15d8df0ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.084923 Oct 13 04:26:47.950990 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 601/1187] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:47 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:48.035520 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-57954dfa-cb44-4fbf-a6a7-3b11036070d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:48.036552 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-57954dfa-cb44-4fbf-a6a7-3b11036070d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:48.044088 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-57954dfa-cb44-4fbf-a6a7-3b11036070d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:48.044577 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-57954dfa-cb44-4fbf-a6a7-3b11036070d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:48.045405 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-57954dfa-cb44-4fbf-a6a7-3b11036070d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:48.045961 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-57954dfa-cb44-4fbf-a6a7-3b11036070d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:48.432761 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-57954dfa-cb44-4fbf-a6a7-3b11036070d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:48.444524 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-57954dfa-cb44-4fbf-a6a7-3b11036070d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:48.446040 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-57954dfa-cb44-4fbf-a6a7-3b11036070d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:48.447218 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-57954dfa-cb44-4fbf-a6a7-3b11036070d4 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1720 microversion: 2.20 time: 0.417978 Oct 13 04:26:48.447758 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 587/1188] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:48 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1720 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:48.964986 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-097d9ae5-2839-42ec-9d28-56abcac274f1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:48.966134 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-097d9ae5-2839-42ec-9d28-56abcac274f1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:48.972914 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-097d9ae5-2839-42ec-9d28-56abcac274f1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:48.973357 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-097d9ae5-2839-42ec-9d28-56abcac274f1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:48.974220 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-097d9ae5-2839-42ec-9d28-56abcac274f1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:48.974645 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-097d9ae5-2839-42ec-9d28-56abcac274f1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:49.051779 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-097d9ae5-2839-42ec-9d28-56abcac274f1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.091029 Oct 13 04:26:49.052439 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 602/1189] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:48 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:49.469003 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5a5d213b-6388-4bae-aeb2-408b03f87722 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:49.470261 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-5a5d213b-6388-4bae-aeb2-408b03f87722 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:49.479389 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5a5d213b-6388-4bae-aeb2-408b03f87722 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:49.479827 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5a5d213b-6388-4bae-aeb2-408b03f87722 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:49.480575 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5a5d213b-6388-4bae-aeb2-408b03f87722 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:49.480993 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5a5d213b-6388-4bae-aeb2-408b03f87722 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:49.603492 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-5a5d213b-6388-4bae-aeb2-408b03f87722 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:49.611664 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-5a5d213b-6388-4bae-aeb2-408b03f87722 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:49.613128 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-5a5d213b-6388-4bae-aeb2-408b03f87722 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:49.614389 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-5a5d213b-6388-4bae-aeb2-408b03f87722 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1741 microversion: 2.20 time: 0.151640 Oct 13 04:26:49.614950 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 588/1190] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:49 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1741 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:50.068589 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b9d73779-a450-4dde-a422-ba0af398a795 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:50.070384 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b9d73779-a450-4dde-a422-ba0af398a795 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:50.077851 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b9d73779-a450-4dde-a422-ba0af398a795 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:50.078317 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b9d73779-a450-4dde-a422-ba0af398a795 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:50.079116 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b9d73779-a450-4dde-a422-ba0af398a795 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:50.079556 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b9d73779-a450-4dde-a422-ba0af398a795 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:50.141636 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b9d73779-a450-4dde-a422-ba0af398a795 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.079760 Oct 13 04:26:50.142551 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 603/1191] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:50 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:50.632925 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-23d16537-d6c8-4cb6-a855-4055d1c42336 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:50.633545 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-23d16537-d6c8-4cb6-a855-4055d1c42336 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:50.639802 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-23d16537-d6c8-4cb6-a855-4055d1c42336 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:50.640254 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-23d16537-d6c8-4cb6-a855-4055d1c42336 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:50.641020 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-23d16537-d6c8-4cb6-a855-4055d1c42336 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:50.641449 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-23d16537-d6c8-4cb6-a855-4055d1c42336 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:50.764530 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-23d16537-d6c8-4cb6-a855-4055d1c42336 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:50.772246 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-23d16537-d6c8-4cb6-a855-4055d1c42336 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:50.773736 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-23d16537-d6c8-4cb6-a855-4055d1c42336 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:50.774911 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-23d16537-d6c8-4cb6-a855-4055d1c42336 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1741 microversion: 2.20 time: 0.145779 Oct 13 04:26:50.775462 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 589/1192] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:50 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1741 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:51.159121 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-aa47e81c-4431-4788-881f-af5a485a6b39 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:51.160655 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-aa47e81c-4431-4788-881f-af5a485a6b39 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:51.176037 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-aa47e81c-4431-4788-881f-af5a485a6b39 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:51.176773 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-aa47e81c-4431-4788-881f-af5a485a6b39 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:51.178078 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-aa47e81c-4431-4788-881f-af5a485a6b39 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:51.178794 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-aa47e81c-4431-4788-881f-af5a485a6b39 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:51.257167 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-aa47e81c-4431-4788-881f-af5a485a6b39 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.106224 Oct 13 04:26:51.257899 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 604/1193] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:51 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:51.797600 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-11f65cdb-735e-44b2-91c4-925c789b967e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:51.798676 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-11f65cdb-735e-44b2-91c4-925c789b967e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:51.808050 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-11f65cdb-735e-44b2-91c4-925c789b967e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:51.808425 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-11f65cdb-735e-44b2-91c4-925c789b967e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:51.809176 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-11f65cdb-735e-44b2-91c4-925c789b967e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:51.809600 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-11f65cdb-735e-44b2-91c4-925c789b967e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:51.935758 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-11f65cdb-735e-44b2-91c4-925c789b967e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:51.946895 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-11f65cdb-735e-44b2-91c4-925c789b967e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:51.949138 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-11f65cdb-735e-44b2-91c4-925c789b967e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:51.950875 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-11f65cdb-735e-44b2-91c4-925c789b967e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1741 microversion: 2.20 time: 0.159243 Oct 13 04:26:51.951624 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 590/1194] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:51 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:52.274215 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-192f32f5-34ac-4a6c-acac-e6e9e7f2ebc7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:52.275805 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-192f32f5-34ac-4a6c-acac-e6e9e7f2ebc7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:52.287129 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-192f32f5-34ac-4a6c-acac-e6e9e7f2ebc7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:52.287828 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-192f32f5-34ac-4a6c-acac-e6e9e7f2ebc7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:52.289116 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-192f32f5-34ac-4a6c-acac-e6e9e7f2ebc7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:52.289866 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-192f32f5-34ac-4a6c-acac-e6e9e7f2ebc7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:52.350539 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-192f32f5-34ac-4a6c-acac-e6e9e7f2ebc7 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.082740 Oct 13 04:26:52.351328 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 605/1195] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:52 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:52.825799 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-dc196b22-dec2-4749-b157-3ae4dc252434 req-f5fb2ec6-fb56-4196-a1a3-44566a8d375d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6451d1-6399-4efc-8b6a-0e57ee0610b8", "name": "network-vif-plugged", "status": "completed", "tag": "b7c271f3-64be-4491-904a-f29a7f6c6c8a"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:52.827318 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:26:52.827318 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:26:52.834712 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-dc196b22-dec2-4749-b157-3ae4dc252434 req-f5fb2ec6-fb56-4196-a1a3-44566a8d375d service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:52.835151 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-dc196b22-dec2-4749-b157-3ae4dc252434 req-f5fb2ec6-fb56-4196-a1a3-44566a8d375d service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:52.846499 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-dc196b22-dec2-4749-b157-3ae4dc252434 req-f5fb2ec6-fb56-4196-a1a3-44566a8d375d service nova] Creating event network-vif-plugged:b7c271f3-64be-4491-904a-f29a7f6c6c8a for instance 7a6451d1-6399-4efc-8b6a-0e57ee0610b8 on hv-cinder-81275 Oct 13 04:26:52.851639 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-dc196b22-dec2-4749-b157-3ae4dc252434 req-f5fb2ec6-fb56-4196-a1a3-44566a8d375d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029624 Oct 13 04:26:52.852202 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 591/1196] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:26:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:26:52.977974 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f516f804-2051-446a-a574-5fdf868246fe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:52.978944 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f516f804-2051-446a-a574-5fdf868246fe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:52.986803 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f516f804-2051-446a-a574-5fdf868246fe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:52.987298 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f516f804-2051-446a-a574-5fdf868246fe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:52.988170 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f516f804-2051-446a-a574-5fdf868246fe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:52.988667 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f516f804-2051-446a-a574-5fdf868246fe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:53.123752 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f516f804-2051-446a-a574-5fdf868246fe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:53.132986 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f516f804-2051-446a-a574-5fdf868246fe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:53.134771 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f516f804-2051-446a-a574-5fdf868246fe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:53.135967 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f516f804-2051-446a-a574-5fdf868246fe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1741 microversion: 2.20 time: 0.164928 Oct 13 04:26:53.136539 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 606/1197] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:52 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:53.368179 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1f3f6da1-daa4-4216-90c6-a7190f74402c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:53.369530 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1f3f6da1-daa4-4216-90c6-a7190f74402c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:53.376838 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1f3f6da1-daa4-4216-90c6-a7190f74402c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:53.377321 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1f3f6da1-daa4-4216-90c6-a7190f74402c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:53.378181 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1f3f6da1-daa4-4216-90c6-a7190f74402c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:53.378646 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1f3f6da1-daa4-4216-90c6-a7190f74402c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:53.441936 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1f3f6da1-daa4-4216-90c6-a7190f74402c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.080482 Oct 13 04:26:53.442547 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 592/1198] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:53 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:54.160559 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a9be1294-2831-416f-aae3-12ac27dbb23c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:54.161482 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a9be1294-2831-416f-aae3-12ac27dbb23c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:54.172342 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a9be1294-2831-416f-aae3-12ac27dbb23c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:54.173066 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a9be1294-2831-416f-aae3-12ac27dbb23c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:54.174294 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a9be1294-2831-416f-aae3-12ac27dbb23c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:54.175034 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a9be1294-2831-416f-aae3-12ac27dbb23c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:54.301943 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a9be1294-2831-416f-aae3-12ac27dbb23c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:54.311918 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a9be1294-2831-416f-aae3-12ac27dbb23c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:54.313396 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a9be1294-2831-416f-aae3-12ac27dbb23c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:54.314598 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a9be1294-2831-416f-aae3-12ac27dbb23c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1741 microversion: 2.20 time: 0.162456 Oct 13 04:26:54.315171 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 607/1199] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:54 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:54.458893 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1e25bd0e-5791-4ebe-bac9-29adeebd04ca tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:54.460564 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1e25bd0e-5791-4ebe-bac9-29adeebd04ca tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:54.471417 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1e25bd0e-5791-4ebe-bac9-29adeebd04ca tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:54.472149 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1e25bd0e-5791-4ebe-bac9-29adeebd04ca tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:54.473446 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1e25bd0e-5791-4ebe-bac9-29adeebd04ca tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:54.474206 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1e25bd0e-5791-4ebe-bac9-29adeebd04ca tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:54.537247 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1e25bd0e-5791-4ebe-bac9-29adeebd04ca tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 28704 microversion: 2.1 time: 0.085102 Oct 13 04:26:54.537911 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 593/1200] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:54 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 28704 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:55.346314 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4ebeb669-46f5-4851-9904-860ae5adf827 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:55.347368 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4ebeb669-46f5-4851-9904-860ae5adf827 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:55.355883 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4ebeb669-46f5-4851-9904-860ae5adf827 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:55.356325 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4ebeb669-46f5-4851-9904-860ae5adf827 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:55.357080 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4ebeb669-46f5-4851-9904-860ae5adf827 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:55.357498 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-4ebeb669-46f5-4851-9904-860ae5adf827 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:55.486464 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4ebeb669-46f5-4851-9904-860ae5adf827 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:55.494353 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4ebeb669-46f5-4851-9904-860ae5adf827 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:55.495760 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4ebeb669-46f5-4851-9904-860ae5adf827 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:55.496917 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4ebeb669-46f5-4851-9904-860ae5adf827 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1741 microversion: 2.20 time: 0.157363 Oct 13 04:26:55.497484 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 608/1201] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:55 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:55.548872 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0407d57c-dfce-43c8-b0a9-005302ffa43f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:55.550006 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0407d57c-dfce-43c8-b0a9-005302ffa43f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:55.556818 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0407d57c-dfce-43c8-b0a9-005302ffa43f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:55.557264 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0407d57c-dfce-43c8-b0a9-005302ffa43f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:55.558071 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0407d57c-dfce-43c8-b0a9-005302ffa43f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:55.558502 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0407d57c-dfce-43c8-b0a9-005302ffa43f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:55.637658 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0407d57c-dfce-43c8-b0a9-005302ffa43f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 30221 microversion: 2.1 time: 0.092438 Oct 13 04:26:55.638565 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 594/1202] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:55 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 30221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:56.515729 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-949ea1b8-0299-4a68-89f1-652a9e44c3fb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:56.516343 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-949ea1b8-0299-4a68-89f1-652a9e44c3fb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:56.534629 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-949ea1b8-0299-4a68-89f1-652a9e44c3fb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:56.536708 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-949ea1b8-0299-4a68-89f1-652a9e44c3fb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:56.538125 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-949ea1b8-0299-4a68-89f1-652a9e44c3fb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:56.538568 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-949ea1b8-0299-4a68-89f1-652a9e44c3fb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:56.651890 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-27f31cc2-d589-4bfc-9ad7-bb09039e62f2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:56.653493 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-27f31cc2-d589-4bfc-9ad7-bb09039e62f2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:56.664580 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-27f31cc2-d589-4bfc-9ad7-bb09039e62f2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:56.665019 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-27f31cc2-d589-4bfc-9ad7-bb09039e62f2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:56.665906 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-27f31cc2-d589-4bfc-9ad7-bb09039e62f2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:56.666337 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-27f31cc2-d589-4bfc-9ad7-bb09039e62f2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:56.696853 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-949ea1b8-0299-4a68-89f1-652a9e44c3fb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:56.706565 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-949ea1b8-0299-4a68-89f1-652a9e44c3fb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:56.708500 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-949ea1b8-0299-4a68-89f1-652a9e44c3fb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:56.710033 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-949ea1b8-0299-4a68-89f1-652a9e44c3fb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1736 microversion: 2.20 time: 0.199364 Oct 13 04:26:56.711209 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 609/1203] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:56 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:56.771221 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-27f31cc2-d589-4bfc-9ad7-bb09039e62f2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 32188 microversion: 2.1 time: 0.123449 Oct 13 04:26:56.772147 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 595/1204] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:56 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 32188 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:26:57.728583 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e0030c72-e3d3-489e-bbab-2ef14ba18f4c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:57.730017 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e0030c72-e3d3-489e-bbab-2ef14ba18f4c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:57.736963 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e0030c72-e3d3-489e-bbab-2ef14ba18f4c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:57.737598 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e0030c72-e3d3-489e-bbab-2ef14ba18f4c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:57.738655 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e0030c72-e3d3-489e-bbab-2ef14ba18f4c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:57.739081 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e0030c72-e3d3-489e-bbab-2ef14ba18f4c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:57.784384 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b4915b39-cc44-425b-84af-6adc7dd2f9e0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:57.785364 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b4915b39-cc44-425b-84af-6adc7dd2f9e0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:57.791794 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b4915b39-cc44-425b-84af-6adc7dd2f9e0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:57.792548 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b4915b39-cc44-425b-84af-6adc7dd2f9e0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:57.793527 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b4915b39-cc44-425b-84af-6adc7dd2f9e0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:57.794176 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b4915b39-cc44-425b-84af-6adc7dd2f9e0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:57.864293 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-e0030c72-e3d3-489e-bbab-2ef14ba18f4c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:57.872867 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-e0030c72-e3d3-489e-bbab-2ef14ba18f4c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:57.874447 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-e0030c72-e3d3-489e-bbab-2ef14ba18f4c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:57.875851 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e0030c72-e3d3-489e-bbab-2ef14ba18f4c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1736 microversion: 2.20 time: 0.151142 Oct 13 04:26:57.876417 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 610/1205] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:57 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:26:57.895137 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b4915b39-cc44-425b-84af-6adc7dd2f9e0 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 33401 microversion: 2.1 time: 0.115153 Oct 13 04:26:57.896479 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 596/1206] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:57 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 33401 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:26:58.893947 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a856ece4-635f-4cdb-98e4-2c7d859bdcc6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:26:58.894530 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a856ece4-635f-4cdb-98e4-2c7d859bdcc6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:58.900544 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a856ece4-635f-4cdb-98e4-2c7d859bdcc6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:58.901342 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a856ece4-635f-4cdb-98e4-2c7d859bdcc6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:58.902179 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a856ece4-635f-4cdb-98e4-2c7d859bdcc6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:58.902766 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a856ece4-635f-4cdb-98e4-2c7d859bdcc6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:58.908836 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-aab0747f-6608-44fc-b467-9e241ef8cd3d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:26:58.910529 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-aab0747f-6608-44fc-b467-9e241ef8cd3d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:26:58.919182 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aab0747f-6608-44fc-b467-9e241ef8cd3d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:58.919762 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aab0747f-6608-44fc-b467-9e241ef8cd3d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:58.920591 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aab0747f-6608-44fc-b467-9e241ef8cd3d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:26:58.921030 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aab0747f-6608-44fc-b467-9e241ef8cd3d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:26:59.021431 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-aab0747f-6608-44fc-b467-9e241ef8cd3d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 34288 microversion: 2.1 time: 0.117228 Oct 13 04:26:59.022206 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 597/1207] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:26:58 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 34288 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:26:59.053390 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a856ece4-635f-4cdb-98e4-2c7d859bdcc6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:59.061656 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a856ece4-635f-4cdb-98e4-2c7d859bdcc6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:59.063149 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-a856ece4-635f-4cdb-98e4-2c7d859bdcc6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:26:59.064333 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a856ece4-635f-4cdb-98e4-2c7d859bdcc6 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1736 microversion: 2.20 time: 0.174243 Oct 13 04:26:59.075663 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 611/1208] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:26:58 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:00.037446 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e0e00a5c-9b39-44ae-9311-cab5b74b09a2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:27:00.038695 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e0e00a5c-9b39-44ae-9311-cab5b74b09a2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:00.045572 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e0e00a5c-9b39-44ae-9311-cab5b74b09a2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:00.046303 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e0e00a5c-9b39-44ae-9311-cab5b74b09a2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:00.047343 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e0e00a5c-9b39-44ae-9311-cab5b74b09a2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:00.047950 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e0e00a5c-9b39-44ae-9311-cab5b74b09a2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:00.085495 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b1e5662b-518e-43d7-9ca3-e83b9d5b27e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:00.086180 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b1e5662b-518e-43d7-9ca3-e83b9d5b27e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:00.092875 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b1e5662b-518e-43d7-9ca3-e83b9d5b27e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:00.093321 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b1e5662b-518e-43d7-9ca3-e83b9d5b27e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:00.094112 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b1e5662b-518e-43d7-9ca3-e83b9d5b27e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:00.094539 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b1e5662b-518e-43d7-9ca3-e83b9d5b27e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:00.126146 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e0e00a5c-9b39-44ae-9311-cab5b74b09a2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 35294 microversion: 2.1 time: 0.095088 Oct 13 04:27:00.127576 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 598/1209] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:27:00 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 35294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:27:00.234697 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b1e5662b-518e-43d7-9ca3-e83b9d5b27e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:00.243010 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b1e5662b-518e-43d7-9ca3-e83b9d5b27e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:00.244595 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b1e5662b-518e-43d7-9ca3-e83b9d5b27e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:00.246004 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b1e5662b-518e-43d7-9ca3-e83b9d5b27e7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1736 microversion: 2.20 time: 0.164309 Oct 13 04:27:00.246642 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 612/1210] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:00 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:01.140450 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-4c76cc35-22eb-48d2-9bf7-93ea7c99e98a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:27:01.142233 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-4c76cc35-22eb-48d2-9bf7-93ea7c99e98a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:01.149665 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4c76cc35-22eb-48d2-9bf7-93ea7c99e98a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:01.150287 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4c76cc35-22eb-48d2-9bf7-93ea7c99e98a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:01.151690 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4c76cc35-22eb-48d2-9bf7-93ea7c99e98a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:01.152124 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-4c76cc35-22eb-48d2-9bf7-93ea7c99e98a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:01.230696 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-4c76cc35-22eb-48d2-9bf7-93ea7c99e98a tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 36446 microversion: 2.1 time: 0.094302 Oct 13 04:27:01.232506 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 599/1211] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:27:01 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 36446 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 04:27:01.265810 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-aa01790b-9df0-40fc-8e41-26a23b374455 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:01.266547 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-aa01790b-9df0-40fc-8e41-26a23b374455 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:01.274433 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-aa01790b-9df0-40fc-8e41-26a23b374455 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:01.275129 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-aa01790b-9df0-40fc-8e41-26a23b374455 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:01.276481 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-aa01790b-9df0-40fc-8e41-26a23b374455 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:01.276983 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-aa01790b-9df0-40fc-8e41-26a23b374455 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:01.409033 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-aa01790b-9df0-40fc-8e41-26a23b374455 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:01.417939 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-aa01790b-9df0-40fc-8e41-26a23b374455 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:01.419860 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-aa01790b-9df0-40fc-8e41-26a23b374455 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:01.421221 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-aa01790b-9df0-40fc-8e41-26a23b374455 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1736 microversion: 2.20 time: 0.160269 Oct 13 04:27:01.422221 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 613/1212] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:01 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:02.244952 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f7d3c282-0b81-4486-a9a2-70efd6e84580 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:27:02.246082 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f7d3c282-0b81-4486-a9a2-70efd6e84580 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:02.254810 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f7d3c282-0b81-4486-a9a2-70efd6e84580 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:02.255238 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f7d3c282-0b81-4486-a9a2-70efd6e84580 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:02.256029 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f7d3c282-0b81-4486-a9a2-70efd6e84580 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:02.256480 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f7d3c282-0b81-4486-a9a2-70efd6e84580 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:02.337503 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f7d3c282-0b81-4486-a9a2-70efd6e84580 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 37758 microversion: 2.1 time: 0.096703 Oct 13 04:27:02.338217 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 600/1213] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:27:02 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 37758 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:27:02.440050 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9879afe0-82fd-46dd-8129-e117c608cd02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:02.440684 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9879afe0-82fd-46dd-8129-e117c608cd02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:02.447966 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9879afe0-82fd-46dd-8129-e117c608cd02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:02.448410 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9879afe0-82fd-46dd-8129-e117c608cd02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:02.449201 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9879afe0-82fd-46dd-8129-e117c608cd02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:02.449636 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9879afe0-82fd-46dd-8129-e117c608cd02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:02.583556 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-9879afe0-82fd-46dd-8129-e117c608cd02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:02.594372 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-9879afe0-82fd-46dd-8129-e117c608cd02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:02.595856 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-9879afe0-82fd-46dd-8129-e117c608cd02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:02.597463 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9879afe0-82fd-46dd-8129-e117c608cd02 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1736 microversion: 2.20 time: 0.161091 Oct 13 04:27:02.598469 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 614/1214] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:02 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 04:27:03.351382 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0171a3d9-6a6b-425a-ac7a-d6b9eb6c70a8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:27:03.352371 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0171a3d9-6a6b-425a-ac7a-d6b9eb6c70a8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:03.360530 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0171a3d9-6a6b-425a-ac7a-d6b9eb6c70a8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:03.361699 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0171a3d9-6a6b-425a-ac7a-d6b9eb6c70a8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:03.363455 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0171a3d9-6a6b-425a-ac7a-d6b9eb6c70a8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:03.364093 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0171a3d9-6a6b-425a-ac7a-d6b9eb6c70a8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:03.455943 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0171a3d9-6a6b-425a-ac7a-d6b9eb6c70a8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 38235 microversion: 2.1 time: 0.109270 Oct 13 04:27:03.457702 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 601/1215] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:27:03 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 38235 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:27:03.618372 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f18d2560-7e22-43d4-990e-484e5298c930 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:03.619201 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f18d2560-7e22-43d4-990e-484e5298c930 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:03.625513 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f18d2560-7e22-43d4-990e-484e5298c930 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:03.626226 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f18d2560-7e22-43d4-990e-484e5298c930 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:03.627223 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f18d2560-7e22-43d4-990e-484e5298c930 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:03.627777 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f18d2560-7e22-43d4-990e-484e5298c930 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:03.749789 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f18d2560-7e22-43d4-990e-484e5298c930 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:03.758509 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f18d2560-7e22-43d4-990e-484e5298c930 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:03.760101 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f18d2560-7e22-43d4-990e-484e5298c930 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:03.761309 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f18d2560-7e22-43d4-990e-484e5298c930 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1736 microversion: 2.20 time: 0.146993 Oct 13 04:27:03.762203 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 615/1216] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:03 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:04.468790 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-814dd72e-e377-4a83-82ce-7cea6e3506ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:27:04.469905 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-814dd72e-e377-4a83-82ce-7cea6e3506ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:04.476892 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-814dd72e-e377-4a83-82ce-7cea6e3506ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:04.477571 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-814dd72e-e377-4a83-82ce-7cea6e3506ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:04.478559 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-814dd72e-e377-4a83-82ce-7cea6e3506ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:04.478996 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-814dd72e-e377-4a83-82ce-7cea6e3506ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:04.572054 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-814dd72e-e377-4a83-82ce-7cea6e3506ab tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 38235 microversion: 2.1 time: 0.107223 Oct 13 04:27:04.576208 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 602/1217] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:27:04 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 38235 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:27:04.780186 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e6829bb0-59e1-40ad-8c8b-2afeb4025f50 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:04.780962 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e6829bb0-59e1-40ad-8c8b-2afeb4025f50 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:04.787156 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e6829bb0-59e1-40ad-8c8b-2afeb4025f50 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:04.787669 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e6829bb0-59e1-40ad-8c8b-2afeb4025f50 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:04.788496 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e6829bb0-59e1-40ad-8c8b-2afeb4025f50 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:04.789165 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e6829bb0-59e1-40ad-8c8b-2afeb4025f50 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:04.917731 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-e6829bb0-59e1-40ad-8c8b-2afeb4025f50 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:04.926780 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-e6829bb0-59e1-40ad-8c8b-2afeb4025f50 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:04.928275 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-e6829bb0-59e1-40ad-8c8b-2afeb4025f50 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:04.929725 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e6829bb0-59e1-40ad-8c8b-2afeb4025f50 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1736 microversion: 2.20 time: 0.153762 Oct 13 04:27:04.940856 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 616/1218] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:04 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:05.584792 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d56ed656-1c09-4493-88b3-290be32155d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:27:05.586615 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d56ed656-1c09-4493-88b3-290be32155d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:05.593549 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d56ed656-1c09-4493-88b3-290be32155d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:05.594320 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d56ed656-1c09-4493-88b3-290be32155d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:05.595183 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d56ed656-1c09-4493-88b3-290be32155d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:05.595711 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d56ed656-1c09-4493-88b3-290be32155d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:05.664609 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d56ed656-1c09-4493-88b3-290be32155d8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 38235 microversion: 2.1 time: 0.083789 Oct 13 04:27:05.665850 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 603/1219] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:27:05 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 38235 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:27:05.950579 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-95736e3e-ac84-42ec-a5d5-e91a86167a6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:05.951260 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-95736e3e-ac84-42ec-a5d5-e91a86167a6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:05.958228 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-95736e3e-ac84-42ec-a5d5-e91a86167a6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:05.958724 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-95736e3e-ac84-42ec-a5d5-e91a86167a6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:05.959548 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-95736e3e-ac84-42ec-a5d5-e91a86167a6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:05.959981 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-95736e3e-ac84-42ec-a5d5-e91a86167a6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:06.089638 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-95736e3e-ac84-42ec-a5d5-e91a86167a6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:06.097251 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-95736e3e-ac84-42ec-a5d5-e91a86167a6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:06.098753 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-95736e3e-ac84-42ec-a5d5-e91a86167a6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:06.099902 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-95736e3e-ac84-42ec-a5d5-e91a86167a6c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1736 microversion: 2.20 time: 0.154177 Oct 13 04:27:06.100424 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 617/1220] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:05 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:06.681778 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-13f0ed75-a8dd-49bd-aed9-f04a4a8aa45d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:27:06.683398 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-13f0ed75-a8dd-49bd-aed9-f04a4a8aa45d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:06.694352 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-13f0ed75-a8dd-49bd-aed9-f04a4a8aa45d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:06.695084 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-13f0ed75-a8dd-49bd-aed9-f04a4a8aa45d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:06.696337 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-13f0ed75-a8dd-49bd-aed9-f04a4a8aa45d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:06.697041 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-13f0ed75-a8dd-49bd-aed9-f04a4a8aa45d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:06.786369 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-13f0ed75-a8dd-49bd-aed9-f04a4a8aa45d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 38235 microversion: 2.1 time: 0.110806 Oct 13 04:27:06.788108 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 604/1221] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:27:06 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 38235 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:27:07.118389 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-97463db9-7992-40bc-a227-1b967cb579dd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:07.119009 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-97463db9-7992-40bc-a227-1b967cb579dd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:07.125147 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-97463db9-7992-40bc-a227-1b967cb579dd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:07.125584 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-97463db9-7992-40bc-a227-1b967cb579dd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:07.126372 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-97463db9-7992-40bc-a227-1b967cb579dd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:07.126791 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-97463db9-7992-40bc-a227-1b967cb579dd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:07.314139 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-97463db9-7992-40bc-a227-1b967cb579dd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:07.322262 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-97463db9-7992-40bc-a227-1b967cb579dd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:07.323837 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-97463db9-7992-40bc-a227-1b967cb579dd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:07.324993 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-97463db9-7992-40bc-a227-1b967cb579dd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1718 microversion: 2.20 time: 0.210419 Oct 13 04:27:07.325544 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 618/1222] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:07 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1718 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:07.806050 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-61c8a15a-26df-4b0e-a5b2-a80d0189cd80 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:27:07.807555 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-61c8a15a-26df-4b0e-a5b2-a80d0189cd80 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:07.814340 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-61c8a15a-26df-4b0e-a5b2-a80d0189cd80 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:07.814774 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-61c8a15a-26df-4b0e-a5b2-a80d0189cd80 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:07.815543 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-61c8a15a-26df-4b0e-a5b2-a80d0189cd80 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:07.816694 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-61c8a15a-26df-4b0e-a5b2-a80d0189cd80 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:07.895933 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-61c8a15a-26df-4b0e-a5b2-a80d0189cd80 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action" status: 200 len: 38364 microversion: 2.1 time: 0.096141 Oct 13 04:27:07.896932 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 605/1223] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Oct 13 04:27:07 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/action => generated 38364 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:27:07.912988 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-a07b16c2-4c19-4e69-a005-2369ad0be63f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:07.913872 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-a07b16c2-4c19-4e69-a005-2369ad0be63f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:07.921323 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a07b16c2-4c19-4e69-a005-2369ad0be63f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:07.921787 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a07b16c2-4c19-4e69-a005-2369ad0be63f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:07.922545 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a07b16c2-4c19-4e69-a005-2369ad0be63f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:07.922961 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-a07b16c2-4c19-4e69-a005-2369ad0be63f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:07.945864 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-a07b16c2-4c19-4e69-a005-2369ad0be63f tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/ips" status: 200 len: 146 microversion: 2.1 time: 0.038869 Oct 13 04:27:07.946412 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 619/1224] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Oct 13 04:27:07 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:27:08.347524 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ccc1e308-4950-4861-8f0c-d3fdde609bfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:08.348518 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ccc1e308-4950-4861-8f0c-d3fdde609bfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:08.359413 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ccc1e308-4950-4861-8f0c-d3fdde609bfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:08.360143 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ccc1e308-4950-4861-8f0c-d3fdde609bfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:08.361396 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ccc1e308-4950-4861-8f0c-d3fdde609bfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:08.362150 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ccc1e308-4950-4861-8f0c-d3fdde609bfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:08.493496 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ccc1e308-4950-4861-8f0c-d3fdde609bfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:08.501527 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ccc1e308-4950-4861-8f0c-d3fdde609bfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:08.503032 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ccc1e308-4950-4861-8f0c-d3fdde609bfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:08.504216 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ccc1e308-4950-4861-8f0c-d3fdde609bfe tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1718 microversion: 2.20 time: 0.163705 Oct 13 04:27:08.504777 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 606/1225] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:08 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1718 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:09.261700 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-fdeb42a2-53b2-414f-a33c-7ea5e3ed8b39 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd551ceb-62bb-4102-9edd-628be2ac8b9e"}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:27:09.262790 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-fdeb42a2-53b2-414f-a33c-7ea5e3ed8b39 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:09.269081 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fdeb42a2-53b2-414f-a33c-7ea5e3ed8b39 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:09.269546 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fdeb42a2-53b2-414f-a33c-7ea5e3ed8b39 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:09.270376 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fdeb42a2-53b2-414f-a33c-7ea5e3ed8b39 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:09.270741 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fdeb42a2-53b2-414f-a33c-7ea5e3ed8b39 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:09.506852 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-fdeb42a2-53b2-414f-a33c-7ea5e3ed8b39 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248942 Oct 13 04:27:09.507540 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 620/1226] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Oct 13 04:27:09 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:27:09.522475 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-2f60b9f6-c0b7-4d70-b69a-e89383f3c62c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:09.523176 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-2f60b9f6-c0b7-4d70-b69a-e89383f3c62c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:09.531535 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2f60b9f6-c0b7-4d70-b69a-e89383f3c62c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:09.531981 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2f60b9f6-c0b7-4d70-b69a-e89383f3c62c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:09.533399 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2f60b9f6-c0b7-4d70-b69a-e89383f3c62c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:09.534055 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-2f60b9f6-c0b7-4d70-b69a-e89383f3c62c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:09.672638 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2f60b9f6-c0b7-4d70-b69a-e89383f3c62c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:09.680616 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2f60b9f6-c0b7-4d70-b69a-e89383f3c62c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:09.682144 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-2f60b9f6-c0b7-4d70-b69a-e89383f3c62c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:09.683303 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-2f60b9f6-c0b7-4d70-b69a-e89383f3c62c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1721 microversion: 2.20 time: 0.164727 Oct 13 04:27:09.683842 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 607/1227] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:09 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:09.702518 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1f3da18b-807a-47b1-92c7-43985184f0fb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9faa58f3-92ab-42ca-9b62-55ff973dfe01"}} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:27:09.703675 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-1f3da18b-807a-47b1-92c7-43985184f0fb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:09.710009 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1f3da18b-807a-47b1-92c7-43985184f0fb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:09.710455 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1f3da18b-807a-47b1-92c7-43985184f0fb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:09.711216 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1f3da18b-807a-47b1-92c7-43985184f0fb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:09.711641 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1f3da18b-807a-47b1-92c7-43985184f0fb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:09.988787 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-1f3da18b-807a-47b1-92c7-43985184f0fb tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.291167 Oct 13 04:27:09.989404 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 621/1228] 10.222.0.55 () {62 vars in 1363 bytes} [Wed Oct 13 04:27:09 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/os-volume_attachments => generated 188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 04:27:10.114612 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-dda1421c-dd13-4c2c-8f9f-516d9a7b4414 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:10.115400 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-dda1421c-dd13-4c2c-8f9f-516d9a7b4414 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:10.124714 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dda1421c-dd13-4c2c-8f9f-516d9a7b4414 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:10.125395 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dda1421c-dd13-4c2c-8f9f-516d9a7b4414 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:10.126518 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dda1421c-dd13-4c2c-8f9f-516d9a7b4414 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:10.127152 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dda1421c-dd13-4c2c-8f9f-516d9a7b4414 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:10.414400 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-dda1421c-dd13-4c2c-8f9f-516d9a7b4414 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/os-volume_attachments/9faa58f3-92ab-42ca-9b62-55ff973dfe01" status: 202 len: 0 microversion: 2.20 time: 0.306501 Oct 13 04:27:10.415032 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 608/1229] 10.222.0.55 () {60 vars in 1456 bytes} [Wed Oct 13 04:27:10 2021] DELETE /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/os-volume_attachments/9faa58f3-92ab-42ca-9b62-55ff973dfe01 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:27:10.474559 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-9b091199-b4a8-4c22-bd4b-b7d352d5998f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:27:10.475081 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-9b091199-b4a8-4c22-bd4b-b7d352d5998f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:10.481473 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9b091199-b4a8-4c22-bd4b-b7d352d5998f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:10.481947 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9b091199-b4a8-4c22-bd4b-b7d352d5998f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:10.482699 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9b091199-b4a8-4c22-bd4b-b7d352d5998f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:10.483122 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-9b091199-b4a8-4c22-bd4b-b7d352d5998f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:10.580256 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-9b091199-b4a8-4c22-bd4b-b7d352d5998f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action" status: 202 len: 0 microversion: 2.20 time: 0.109468 Oct 13 04:27:10.582578 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 622/1230] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Oct 13 04:27:10 2021] POST /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:27:10.588895 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-15e5d89b-ebd0-47c7-a49c-572a3886d40f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:10.589596 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-15e5d89b-ebd0-47c7-a49c-572a3886d40f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:10.596195 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-15e5d89b-ebd0-47c7-a49c-572a3886d40f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:10.596881 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-15e5d89b-ebd0-47c7-a49c-572a3886d40f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:10.597655 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-15e5d89b-ebd0-47c7-a49c-572a3886d40f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:10.598105 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-15e5d89b-ebd0-47c7-a49c-572a3886d40f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:10.731703 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-932b0c07-f348-449b-a4bc-1e2bd602f43a req-ea3754fb-9e68-4200-bfad-d6a7fdb22a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6451d1-6399-4efc-8b6a-0e57ee0610b8", "name": "network-vif-unplugged", "status": "completed", "tag": "b7c271f3-64be-4491-904a-f29a7f6c6c8a"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:27:10.740430 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-15e5d89b-ebd0-47c7-a49c-572a3886d40f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:10.743984 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:27:10.743984 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:27:10.748607 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-15e5d89b-ebd0-47c7-a49c-572a3886d40f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:10.750471 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-15e5d89b-ebd0-47c7-a49c-572a3886d40f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:10.751809 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-15e5d89b-ebd0-47c7-a49c-572a3886d40f tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1669 microversion: 2.20 time: 0.166691 Oct 13 04:27:10.758619 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-932b0c07-f348-449b-a4bc-1e2bd602f43a req-ea3754fb-9e68-4200-bfad-d6a7fdb22a32 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:10.759324 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-932b0c07-f348-449b-a4bc-1e2bd602f43a req-ea3754fb-9e68-4200-bfad-d6a7fdb22a32 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:10.763666 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 609/1231] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:10 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1669 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:10.770991 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.compute.server_external_events [req-932b0c07-f348-449b-a4bc-1e2bd602f43a req-ea3754fb-9e68-4200-bfad-d6a7fdb22a32 service nova] Unable to find a host for instance 7a6451d1-6399-4efc-8b6a-0e57ee0610b8. Dropping event network-vif-unplugged {{(pid=108260) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 13 04:27:10.771873 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-932b0c07-f348-449b-a4bc-1e2bd602f43a req-ea3754fb-9e68-4200-bfad-d6a7fdb22a32 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.046828 Oct 13 04:27:10.772446 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 623/1232] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:27:10 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 13 04:27:11.770944 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-e3e03383-28f2-4875-b81e-213f35e39704 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:11.771536 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-e3e03383-28f2-4875-b81e-213f35e39704 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:11.778489 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e3e03383-28f2-4875-b81e-213f35e39704 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:11.778925 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e3e03383-28f2-4875-b81e-213f35e39704 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:11.779674 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e3e03383-28f2-4875-b81e-213f35e39704 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:11.780117 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-e3e03383-28f2-4875-b81e-213f35e39704 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:11.972517 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-e3e03383-28f2-4875-b81e-213f35e39704 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:11.980381 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-e3e03383-28f2-4875-b81e-213f35e39704 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:11.981888 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-e3e03383-28f2-4875-b81e-213f35e39704 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:11.983036 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-e3e03383-28f2-4875-b81e-213f35e39704 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.215967 Oct 13 04:27:11.983603 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 610/1233] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:11 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:13.001851 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-ebeed035-b523-4cb2-b8e6-58ea9915221b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:13.002486 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-ebeed035-b523-4cb2-b8e6-58ea9915221b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:13.009200 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ebeed035-b523-4cb2-b8e6-58ea9915221b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:13.009653 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ebeed035-b523-4cb2-b8e6-58ea9915221b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:13.010459 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ebeed035-b523-4cb2-b8e6-58ea9915221b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:13.010891 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-ebeed035-b523-4cb2-b8e6-58ea9915221b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:13.142309 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-ebeed035-b523-4cb2-b8e6-58ea9915221b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:13.151455 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-ebeed035-b523-4cb2-b8e6-58ea9915221b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:13.152968 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-ebeed035-b523-4cb2-b8e6-58ea9915221b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:13.154020 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-ebeed035-b523-4cb2-b8e6-58ea9915221b tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.156081 Oct 13 04:27:13.166250 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 624/1234] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:12 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:14.188146 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-30c68305-8a9f-4487-88cb-5ebdbc22e0c7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:14.188877 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-30c68305-8a9f-4487-88cb-5ebdbc22e0c7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:14.196994 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30c68305-8a9f-4487-88cb-5ebdbc22e0c7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:14.197550 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30c68305-8a9f-4487-88cb-5ebdbc22e0c7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:14.198530 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30c68305-8a9f-4487-88cb-5ebdbc22e0c7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:14.199064 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-30c68305-8a9f-4487-88cb-5ebdbc22e0c7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:14.326759 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-30c68305-8a9f-4487-88cb-5ebdbc22e0c7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:14.334425 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-30c68305-8a9f-4487-88cb-5ebdbc22e0c7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:14.335909 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-30c68305-8a9f-4487-88cb-5ebdbc22e0c7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:14.337055 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-30c68305-8a9f-4487-88cb-5ebdbc22e0c7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.155163 Oct 13 04:27:14.337701 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 611/1235] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:14 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:15.355198 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1f093bfd-9a71-4214-a2a3-d93f795a677c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:15.355794 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-1f093bfd-9a71-4214-a2a3-d93f795a677c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:15.362078 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1f093bfd-9a71-4214-a2a3-d93f795a677c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:15.362611 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1f093bfd-9a71-4214-a2a3-d93f795a677c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:15.363370 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1f093bfd-9a71-4214-a2a3-d93f795a677c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:15.363772 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1f093bfd-9a71-4214-a2a3-d93f795a677c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:15.486946 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-1f093bfd-9a71-4214-a2a3-d93f795a677c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:15.495085 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-1f093bfd-9a71-4214-a2a3-d93f795a677c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:15.496538 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-1f093bfd-9a71-4214-a2a3-d93f795a677c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:15.497756 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-1f093bfd-9a71-4214-a2a3-d93f795a677c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.146204 Oct 13 04:27:15.498247 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 625/1236] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:15 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:16.516560 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ed78462b-70c1-4325-b943-40179fd802ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:16.517186 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ed78462b-70c1-4325-b943-40179fd802ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:16.523524 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ed78462b-70c1-4325-b943-40179fd802ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:16.523966 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ed78462b-70c1-4325-b943-40179fd802ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:16.524727 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ed78462b-70c1-4325-b943-40179fd802ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:16.525149 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ed78462b-70c1-4325-b943-40179fd802ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:16.648621 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ed78462b-70c1-4325-b943-40179fd802ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:16.657818 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ed78462b-70c1-4325-b943-40179fd802ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:16.659643 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ed78462b-70c1-4325-b943-40179fd802ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:16.661060 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ed78462b-70c1-4325-b943-40179fd802ee tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.148311 Oct 13 04:27:16.672014 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 612/1237] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:16 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:17.679894 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-515f73fa-dc6d-4b40-b50d-44d0f2aacc08 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:17.680492 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-515f73fa-dc6d-4b40-b50d-44d0f2aacc08 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:17.686952 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-515f73fa-dc6d-4b40-b50d-44d0f2aacc08 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:17.687402 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-515f73fa-dc6d-4b40-b50d-44d0f2aacc08 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:17.688173 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-515f73fa-dc6d-4b40-b50d-44d0f2aacc08 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:17.688600 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-515f73fa-dc6d-4b40-b50d-44d0f2aacc08 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:17.821128 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-515f73fa-dc6d-4b40-b50d-44d0f2aacc08 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:17.830867 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-515f73fa-dc6d-4b40-b50d-44d0f2aacc08 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:17.832324 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-515f73fa-dc6d-4b40-b50d-44d0f2aacc08 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:17.833512 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-515f73fa-dc6d-4b40-b50d-44d0f2aacc08 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.157496 Oct 13 04:27:17.834192 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 626/1238] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:17 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:18.855572 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-adb20cec-aea0-42bb-bcb4-ea128f6e45be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:18.856428 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-adb20cec-aea0-42bb-bcb4-ea128f6e45be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:18.865809 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-adb20cec-aea0-42bb-bcb4-ea128f6e45be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:18.866522 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-adb20cec-aea0-42bb-bcb4-ea128f6e45be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:18.867676 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-adb20cec-aea0-42bb-bcb4-ea128f6e45be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:18.868334 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-adb20cec-aea0-42bb-bcb4-ea128f6e45be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:19.004034 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-adb20cec-aea0-42bb-bcb4-ea128f6e45be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:19.012622 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-adb20cec-aea0-42bb-bcb4-ea128f6e45be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:19.014664 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-adb20cec-aea0-42bb-bcb4-ea128f6e45be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:19.016221 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-adb20cec-aea0-42bb-bcb4-ea128f6e45be tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.166837 Oct 13 04:27:19.017523 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 613/1239] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:18 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:20.039796 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5e17bceb-c04b-4928-bfed-3cbad6cc70e1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:20.040720 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5e17bceb-c04b-4928-bfed-3cbad6cc70e1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:20.049480 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5e17bceb-c04b-4928-bfed-3cbad6cc70e1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:20.049951 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5e17bceb-c04b-4928-bfed-3cbad6cc70e1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:20.050729 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5e17bceb-c04b-4928-bfed-3cbad6cc70e1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:20.051158 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5e17bceb-c04b-4928-bfed-3cbad6cc70e1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:20.175666 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5e17bceb-c04b-4928-bfed-3cbad6cc70e1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:20.183888 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5e17bceb-c04b-4928-bfed-3cbad6cc70e1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:20.185353 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5e17bceb-c04b-4928-bfed-3cbad6cc70e1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:20.186522 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5e17bceb-c04b-4928-bfed-3cbad6cc70e1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.153603 Oct 13 04:27:20.187185 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 627/1240] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:20 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:21.204517 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ac1c8c5a-249b-49f4-9a4d-c82e60c3a0e3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:21.205123 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ac1c8c5a-249b-49f4-9a4d-c82e60c3a0e3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:21.210996 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ac1c8c5a-249b-49f4-9a4d-c82e60c3a0e3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:21.211434 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ac1c8c5a-249b-49f4-9a4d-c82e60c3a0e3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:21.212169 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ac1c8c5a-249b-49f4-9a4d-c82e60c3a0e3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:21.212588 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ac1c8c5a-249b-49f4-9a4d-c82e60c3a0e3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:21.340035 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ac1c8c5a-249b-49f4-9a4d-c82e60c3a0e3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:21.370969 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ac1c8c5a-249b-49f4-9a4d-c82e60c3a0e3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:21.372452 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ac1c8c5a-249b-49f4-9a4d-c82e60c3a0e3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:21.373588 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ac1c8c5a-249b-49f4-9a4d-c82e60c3a0e3 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.173035 Oct 13 04:27:21.374183 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 614/1241] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:21 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:22.395733 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d9803664-e22c-4632-bbd7-3793cad69e2a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:22.396852 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d9803664-e22c-4632-bbd7-3793cad69e2a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:22.407586 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d9803664-e22c-4632-bbd7-3793cad69e2a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:22.408111 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d9803664-e22c-4632-bbd7-3793cad69e2a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:22.408994 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d9803664-e22c-4632-bbd7-3793cad69e2a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:22.409475 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d9803664-e22c-4632-bbd7-3793cad69e2a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:22.548312 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d9803664-e22c-4632-bbd7-3793cad69e2a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:22.557733 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d9803664-e22c-4632-bbd7-3793cad69e2a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:22.559209 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d9803664-e22c-4632-bbd7-3793cad69e2a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:22.560403 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d9803664-e22c-4632-bbd7-3793cad69e2a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.171043 Oct 13 04:27:22.561182 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 628/1242] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:22 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:23.578818 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3c2dcb3d-db75-4d1e-9a8a-adcef5a5c2b1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:23.579470 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3c2dcb3d-db75-4d1e-9a8a-adcef5a5c2b1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:23.585915 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3c2dcb3d-db75-4d1e-9a8a-adcef5a5c2b1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:23.586373 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3c2dcb3d-db75-4d1e-9a8a-adcef5a5c2b1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:23.587151 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3c2dcb3d-db75-4d1e-9a8a-adcef5a5c2b1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:23.587578 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3c2dcb3d-db75-4d1e-9a8a-adcef5a5c2b1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:23.827700 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-3c2dcb3d-db75-4d1e-9a8a-adcef5a5c2b1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:23.835360 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-3c2dcb3d-db75-4d1e-9a8a-adcef5a5c2b1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:23.836866 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-3c2dcb3d-db75-4d1e-9a8a-adcef5a5c2b1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:23.838034 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3c2dcb3d-db75-4d1e-9a8a-adcef5a5c2b1 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.263080 Oct 13 04:27:23.838595 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 615/1243] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:23 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:24.856856 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-930dd9c8-8e02-40fd-858f-3763e538ea62 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:24.858399 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-930dd9c8-8e02-40fd-858f-3763e538ea62 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:24.865348 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-930dd9c8-8e02-40fd-858f-3763e538ea62 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:24.865819 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-930dd9c8-8e02-40fd-858f-3763e538ea62 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:24.866596 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-930dd9c8-8e02-40fd-858f-3763e538ea62 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:24.867273 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-930dd9c8-8e02-40fd-858f-3763e538ea62 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:25.047396 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-930dd9c8-8e02-40fd-858f-3763e538ea62 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:25.055196 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-930dd9c8-8e02-40fd-858f-3763e538ea62 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:25.056717 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-930dd9c8-8e02-40fd-858f-3763e538ea62 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:25.057893 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-930dd9c8-8e02-40fd-858f-3763e538ea62 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.205156 Oct 13 04:27:25.058730 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 629/1244] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:24 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:26.080117 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ed9ba974-e4eb-4dba-acd9-0fd70a84887a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:26.081337 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ed9ba974-e4eb-4dba-acd9-0fd70a84887a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:26.091422 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ed9ba974-e4eb-4dba-acd9-0fd70a84887a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:26.092157 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ed9ba974-e4eb-4dba-acd9-0fd70a84887a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:26.093476 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ed9ba974-e4eb-4dba-acd9-0fd70a84887a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:26.094320 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ed9ba974-e4eb-4dba-acd9-0fd70a84887a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:26.227263 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ed9ba974-e4eb-4dba-acd9-0fd70a84887a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:26.235548 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ed9ba974-e4eb-4dba-acd9-0fd70a84887a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:26.237067 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-ed9ba974-e4eb-4dba-acd9-0fd70a84887a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:26.238259 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ed9ba974-e4eb-4dba-acd9-0fd70a84887a tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.164445 Oct 13 04:27:26.238826 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 616/1245] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:26 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:27.261101 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-76073b56-478a-4246-902b-e8ab4bed4ccf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:27.261926 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-76073b56-478a-4246-902b-e8ab4bed4ccf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:27.270184 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-76073b56-478a-4246-902b-e8ab4bed4ccf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:27.270623 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-76073b56-478a-4246-902b-e8ab4bed4ccf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:27.271373 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-76073b56-478a-4246-902b-e8ab4bed4ccf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:27.271794 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-76073b56-478a-4246-902b-e8ab4bed4ccf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:27.405763 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-76073b56-478a-4246-902b-e8ab4bed4ccf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:27.413585 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-76073b56-478a-4246-902b-e8ab4bed4ccf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:27.415090 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-76073b56-478a-4246-902b-e8ab4bed4ccf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:27.416237 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-76073b56-478a-4246-902b-e8ab4bed4ccf tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.161291 Oct 13 04:27:27.416797 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 630/1246] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:27 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:28.438663 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-16b23161-7b0d-423e-a983-5e7d94c21f53 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:28.439790 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-16b23161-7b0d-423e-a983-5e7d94c21f53 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:28.447258 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-16b23161-7b0d-423e-a983-5e7d94c21f53 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:28.447784 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-16b23161-7b0d-423e-a983-5e7d94c21f53 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:28.448672 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-16b23161-7b0d-423e-a983-5e7d94c21f53 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:28.449178 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-16b23161-7b0d-423e-a983-5e7d94c21f53 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:28.578075 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-16b23161-7b0d-423e-a983-5e7d94c21f53 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:28.586681 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-16b23161-7b0d-423e-a983-5e7d94c21f53 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:28.588149 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-16b23161-7b0d-423e-a983-5e7d94c21f53 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:28.589602 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-16b23161-7b0d-423e-a983-5e7d94c21f53 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.157037 Oct 13 04:27:28.590775 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 617/1247] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:28 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:29.608592 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-25d93534-0520-403a-a1b1-c12977c94f42 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:29.609189 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-25d93534-0520-403a-a1b1-c12977c94f42 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:29.616231 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-25d93534-0520-403a-a1b1-c12977c94f42 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:29.616231 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-25d93534-0520-403a-a1b1-c12977c94f42 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:29.617022 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-25d93534-0520-403a-a1b1-c12977c94f42 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:29.617439 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-25d93534-0520-403a-a1b1-c12977c94f42 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:29.714399 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8042ff66-fa19-467a-a020-a07caaff63c1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:29.715355 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-8042ff66-fa19-467a-a020-a07caaff63c1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:29.721862 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8042ff66-fa19-467a-a020-a07caaff63c1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:29.722303 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8042ff66-fa19-467a-a020-a07caaff63c1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:29.723057 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8042ff66-fa19-467a-a020-a07caaff63c1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:29.723480 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8042ff66-fa19-467a-a020-a07caaff63c1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:29.742637 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-25d93534-0520-403a-a1b1-c12977c94f42 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:29.750409 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-25d93534-0520-403a-a1b1-c12977c94f42 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:29.751875 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-25d93534-0520-403a-a1b1-c12977c94f42 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:29.752884 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-8042ff66-fa19-467a-a020-a07caaff63c1 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042139 Oct 13 04:27:29.753074 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-25d93534-0520-403a-a1b1-c12977c94f42 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.148308 Oct 13 04:27:29.753729 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 618/1248] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:27:29 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 04:27:29.753872 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 631/1249] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:29 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:29.763525 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-9c1fb991-ac83-41af-a982-01ece5b02649 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:29.764011 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-9c1fb991-ac83-41af-a982-01ece5b02649 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:29.769915 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9c1fb991-ac83-41af-a982-01ece5b02649 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:29.770358 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9c1fb991-ac83-41af-a982-01ece5b02649 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:29.771115 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9c1fb991-ac83-41af-a982-01ece5b02649 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:29.771541 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9c1fb991-ac83-41af-a982-01ece5b02649 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:29.800420 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-9c1fb991-ac83-41af-a982-01ece5b02649 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments/bd551ceb-62bb-4102-9edd-628be2ac8b9e" status: 200 len: 194 microversion: 2.1 time: 0.040730 Oct 13 04:27:29.800997 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 619/1250] 10.222.0.55 () {58 vars in 1412 bytes} [Wed Oct 13 04:27:29 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments/bd551ceb-62bb-4102-9edd-628be2ac8b9e => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:27:30.774420 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-fda5f286-b752-43fe-914b-a4afbba63fdd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:30.775377 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-fda5f286-b752-43fe-914b-a4afbba63fdd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:30.784336 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fda5f286-b752-43fe-914b-a4afbba63fdd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:30.784892 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fda5f286-b752-43fe-914b-a4afbba63fdd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:30.786149 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fda5f286-b752-43fe-914b-a4afbba63fdd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:30.786572 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fda5f286-b752-43fe-914b-a4afbba63fdd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:30.910854 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-fda5f286-b752-43fe-914b-a4afbba63fdd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:30.918602 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-fda5f286-b752-43fe-914b-a4afbba63fdd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:30.920070 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-fda5f286-b752-43fe-914b-a4afbba63fdd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:30.921246 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-fda5f286-b752-43fe-914b-a4afbba63fdd tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.152892 Oct 13 04:27:30.921837 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 632/1251] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:30 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:31.123231 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-db38368a-0a24-4ea3-8196-4c54dbfa4a19 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cde92611-e451-498f-a574-8d48e69ab394"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:27:31.124573 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-db38368a-0a24-4ea3-8196-4c54dbfa4a19 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:31.131927 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-db38368a-0a24-4ea3-8196-4c54dbfa4a19 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:31.132393 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-db38368a-0a24-4ea3-8196-4c54dbfa4a19 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:31.133320 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-db38368a-0a24-4ea3-8196-4c54dbfa4a19 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:31.133936 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-db38368a-0a24-4ea3-8196-4c54dbfa4a19 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:31.387234 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-db38368a-0a24-4ea3-8196-4c54dbfa4a19 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269804 Oct 13 04:27:31.388051 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 620/1252] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Oct 13 04:27:31 2021] POST /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:27:31.946007 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-fc87ac9d-09d6-42c9-9b73-2736059201a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:31.946555 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-fc87ac9d-09d6-42c9-9b73-2736059201a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:31.953159 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fc87ac9d-09d6-42c9-9b73-2736059201a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:31.953595 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fc87ac9d-09d6-42c9-9b73-2736059201a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:31.954381 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fc87ac9d-09d6-42c9-9b73-2736059201a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:31.954805 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fc87ac9d-09d6-42c9-9b73-2736059201a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:32.091729 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-fc87ac9d-09d6-42c9-9b73-2736059201a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:32.100298 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-fc87ac9d-09d6-42c9-9b73-2736059201a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:32.101821 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-fc87ac9d-09d6-42c9-9b73-2736059201a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:32.102959 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-fc87ac9d-09d6-42c9-9b73-2736059201a2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.161444 Oct 13 04:27:32.103509 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 633/1253] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:31 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:32.883657 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-1d7113e4-6eef-44c8-8c4d-9e827cb91e08 req-67387fca-76e0-47ba-aae7-8d6b5976e1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6451d1-6399-4efc-8b6a-0e57ee0610b8", "name": "network-vif-plugged", "status": "completed", "tag": "b7c271f3-64be-4491-904a-f29a7f6c6c8a"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:27:32.885206 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:27:32.885206 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:27:32.893994 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-1d7113e4-6eef-44c8-8c4d-9e827cb91e08 req-67387fca-76e0-47ba-aae7-8d6b5976e1d0 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:32.894432 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-1d7113e4-6eef-44c8-8c4d-9e827cb91e08 req-67387fca-76e0-47ba-aae7-8d6b5976e1d0 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:32.904948 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-1d7113e4-6eef-44c8-8c4d-9e827cb91e08 req-67387fca-76e0-47ba-aae7-8d6b5976e1d0 service nova] Creating event network-vif-plugged:b7c271f3-64be-4491-904a-f29a7f6c6c8a for instance 7a6451d1-6399-4efc-8b6a-0e57ee0610b8 on hv-cinder-81275 Oct 13 04:27:32.909826 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-1d7113e4-6eef-44c8-8c4d-9e827cb91e08 req-67387fca-76e0-47ba-aae7-8d6b5976e1d0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030718 Oct 13 04:27:32.910579 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 621/1254] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:27:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:27:33.122012 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-cdc235b2-2ca3-4c8b-a754-32b053e89379 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:33.122641 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-cdc235b2-2ca3-4c8b-a754-32b053e89379 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:33.128955 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cdc235b2-2ca3-4c8b-a754-32b053e89379 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:33.129391 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cdc235b2-2ca3-4c8b-a754-32b053e89379 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:33.130177 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cdc235b2-2ca3-4c8b-a754-32b053e89379 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:33.130600 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-cdc235b2-2ca3-4c8b-a754-32b053e89379 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:33.248729 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-cdc235b2-2ca3-4c8b-a754-32b053e89379 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:33.256963 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-cdc235b2-2ca3-4c8b-a754-32b053e89379 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:33.258456 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-cdc235b2-2ca3-4c8b-a754-32b053e89379 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:33.259633 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-cdc235b2-2ca3-4c8b-a754-32b053e89379 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.141810 Oct 13 04:27:33.260404 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 634/1255] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:33 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:34.283172 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5bde1840-10b1-4487-aad9-a2ad063f79a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:34.284295 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-5bde1840-10b1-4487-aad9-a2ad063f79a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:34.292118 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5bde1840-10b1-4487-aad9-a2ad063f79a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:34.292557 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5bde1840-10b1-4487-aad9-a2ad063f79a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:34.293322 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5bde1840-10b1-4487-aad9-a2ad063f79a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:34.293783 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5bde1840-10b1-4487-aad9-a2ad063f79a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:34.416592 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-5bde1840-10b1-4487-aad9-a2ad063f79a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:34.424326 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-5bde1840-10b1-4487-aad9-a2ad063f79a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:34.425822 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-5bde1840-10b1-4487-aad9-a2ad063f79a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:34.426968 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-5bde1840-10b1-4487-aad9-a2ad063f79a5 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1727 microversion: 2.20 time: 0.150706 Oct 13 04:27:34.427500 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 622/1256] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:34 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:35.449346 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-408558f4-a038-4390-8878-15463fcaac54 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:35.450352 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-408558f4-a038-4390-8878-15463fcaac54 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:35.459956 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-408558f4-a038-4390-8878-15463fcaac54 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:35.460396 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-408558f4-a038-4390-8878-15463fcaac54 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:35.461147 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-408558f4-a038-4390-8878-15463fcaac54 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:35.461572 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-408558f4-a038-4390-8878-15463fcaac54 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:35.591456 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-408558f4-a038-4390-8878-15463fcaac54 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:35.600323 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-408558f4-a038-4390-8878-15463fcaac54 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:35.601838 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-408558f4-a038-4390-8878-15463fcaac54 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:35.602991 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-408558f4-a038-4390-8878-15463fcaac54 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1714 microversion: 2.20 time: 0.159926 Oct 13 04:27:35.603550 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 635/1257] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:27:35 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1714 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:27:37.608331 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 04:27:37.608999 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: Wed Oct 13 04:27:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 13 04:27:38.912379 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-f86bbc90-690a-4af0-8a07-007e832927ee tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:38.913340 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-f86bbc90-690a-4af0-8a07-007e832927ee tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:38.920616 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f86bbc90-690a-4af0-8a07-007e832927ee tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:38.921055 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f86bbc90-690a-4af0-8a07-007e832927ee tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:38.921853 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f86bbc90-690a-4af0-8a07-007e832927ee tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:38.922286 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-f86bbc90-690a-4af0-8a07-007e832927ee tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:38.952198 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-f86bbc90-690a-4af0-8a07-007e832927ee tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043563 Oct 13 04:27:38.952755 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 623/1258] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:27:38 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:27:39.203382 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-c445bbc5-6e9b-474a-bd6c-f5fff3be6161 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:39.204227 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-c445bbc5-6e9b-474a-bd6c-f5fff3be6161 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:39.212964 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c445bbc5-6e9b-474a-bd6c-f5fff3be6161 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:39.213404 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c445bbc5-6e9b-474a-bd6c-f5fff3be6161 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:39.214181 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c445bbc5-6e9b-474a-bd6c-f5fff3be6161 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:39.214601 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-c445bbc5-6e9b-474a-bd6c-f5fff3be6161 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:39.244522 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-c445bbc5-6e9b-474a-bd6c-f5fff3be6161 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments/bd551ceb-62bb-4102-9edd-628be2ac8b9e" status: 200 len: 194 microversion: 2.1 time: 0.047639 Oct 13 04:27:39.245092 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 636/1259] 10.222.0.55 () {58 vars in 1412 bytes} [Wed Oct 13 04:27:39 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments/bd551ceb-62bb-4102-9edd-628be2ac8b9e => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:27:39.254737 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-3182a841-ad8e-4464-8d3e-d453bf5be9a8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:39.255224 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-3182a841-ad8e-4464-8d3e-d453bf5be9a8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:39.261482 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3182a841-ad8e-4464-8d3e-d453bf5be9a8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:39.262272 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3182a841-ad8e-4464-8d3e-d453bf5be9a8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:39.262718 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3182a841-ad8e-4464-8d3e-d453bf5be9a8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:39.263146 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-3182a841-ad8e-4464-8d3e-d453bf5be9a8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:39.346669 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-3182a841-ad8e-4464-8d3e-d453bf5be9a8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lazy-loading 'services' on Instance uuid 8300b425-7073-4360-8038-343600de405f {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:27:39.423888 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-3182a841-ad8e-4464-8d3e-d453bf5be9a8 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments/bd551ceb-62bb-4102-9edd-628be2ac8b9e" status: 202 len: 0 microversion: 2.1 time: 0.172753 Oct 13 04:27:39.424449 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 624/1260] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Oct 13 04:27:39 2021] DELETE /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments/bd551ceb-62bb-4102-9edd-628be2ac8b9e => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:27:41.606075 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5d1f31ae-2823-4e25-b57f-b31124d63830 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:41.606600 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5d1f31ae-2823-4e25-b57f-b31124d63830 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:41.612788 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5d1f31ae-2823-4e25-b57f-b31124d63830 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:41.613227 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5d1f31ae-2823-4e25-b57f-b31124d63830 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:41.614020 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5d1f31ae-2823-4e25-b57f-b31124d63830 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:41.614418 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5d1f31ae-2823-4e25-b57f-b31124d63830 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:41.643733 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5d1f31ae-2823-4e25-b57f-b31124d63830 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments/cde92611-e451-498f-a574-8d48e69ab394" status: 200 len: 194 microversion: 2.1 time: 0.041431 Oct 13 04:27:41.644306 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 637/1261] 10.222.0.55 () {58 vars in 1412 bytes} [Wed Oct 13 04:27:41 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments/cde92611-e451-498f-a574-8d48e69ab394 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:27:41.655042 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d84348a6-66a8-4e8a-9b2d-e18fbdf9157d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:41.655566 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d84348a6-66a8-4e8a-9b2d-e18fbdf9157d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:41.662424 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d84348a6-66a8-4e8a-9b2d-e18fbdf9157d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:41.662861 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d84348a6-66a8-4e8a-9b2d-e18fbdf9157d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:41.663720 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d84348a6-66a8-4e8a-9b2d-e18fbdf9157d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:41.664150 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d84348a6-66a8-4e8a-9b2d-e18fbdf9157d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:41.739758 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.objects.instance [None req-d84348a6-66a8-4e8a-9b2d-e18fbdf9157d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lazy-loading 'services' on Instance uuid 8300b425-7073-4360-8038-343600de405f {{(pid=108259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 13 04:27:41.823205 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d84348a6-66a8-4e8a-9b2d-e18fbdf9157d tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments/cde92611-e451-498f-a574-8d48e69ab394" status: 202 len: 0 microversion: 2.1 time: 0.172137 Oct 13 04:27:41.823810 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 625/1262] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Oct 13 04:27:41 2021] DELETE /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments/cde92611-e451-498f-a574-8d48e69ab394 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:27:42.981644 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-57647eef-915b-48e4-95a3-6f654a658987 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:42.982650 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-57647eef-915b-48e4-95a3-6f654a658987 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:42.988699 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-57647eef-915b-48e4-95a3-6f654a658987 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:42.989132 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-57647eef-915b-48e4-95a3-6f654a658987 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:42.989919 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-57647eef-915b-48e4-95a3-6f654a658987 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:42.990327 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-57647eef-915b-48e4-95a3-6f654a658987 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:43.020280 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-57647eef-915b-48e4-95a3-6f654a658987 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042345 Oct 13 04:27:43.020824 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 638/1263] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:27:42 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 04:27:43.123603 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-aa2cb0ec-ae8c-478d-b124-de412c4d9dc2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:43.124647 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-aa2cb0ec-ae8c-478d-b124-de412c4d9dc2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:43.131594 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aa2cb0ec-ae8c-478d-b124-de412c4d9dc2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:43.132085 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aa2cb0ec-ae8c-478d-b124-de412c4d9dc2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:43.132852 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aa2cb0ec-ae8c-478d-b124-de412c4d9dc2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:43.133278 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-aa2cb0ec-ae8c-478d-b124-de412c4d9dc2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:43.168235 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-aa2cb0ec-ae8c-478d-b124-de412c4d9dc2 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049403 Oct 13 04:27:43.168671 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 626/1264] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Oct 13 04:27:43 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 04:27:43.223337 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b0a768e9-c1e3-4707-986d-c46cca1c0d99 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:43.223818 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b0a768e9-c1e3-4707-986d-c46cca1c0d99 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:43.230078 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0a768e9-c1e3-4707-986d-c46cca1c0d99 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:43.230509 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0a768e9-c1e3-4707-986d-c46cca1c0d99 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:43.231254 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0a768e9-c1e3-4707-986d-c46cca1c0d99 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:43.231669 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b0a768e9-c1e3-4707-986d-c46cca1c0d99 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:43.262242 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b0a768e9-c1e3-4707-986d-c46cca1c0d99 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Going to try to terminate instance {{(pid=108260) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:27:43.349751 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b0a768e9-c1e3-4707-986d-c46cca1c0d99 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 204 len: 0 microversion: 2.1 time: 0.129749 Oct 13 04:27:43.350339 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 639/1265] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:27:43 2021] DELETE /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:27:43.359171 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7b9996cf-8977-457b-887c-71410579e30e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:43.359770 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7b9996cf-8977-457b-887c-71410579e30e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:43.365586 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7b9996cf-8977-457b-887c-71410579e30e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:43.366049 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7b9996cf-8977-457b-887c-71410579e30e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:43.366792 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7b9996cf-8977-457b-887c-71410579e30e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:43.367181 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7b9996cf-8977-457b-887c-71410579e30e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:43.498333 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-7b9996cf-8977-457b-887c-71410579e30e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:43.506068 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7b9996cf-8977-457b-887c-71410579e30e tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 200 len: 1674 microversion: 2.1 time: 0.150600 Oct 13 04:27:43.506630 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 627/1266] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:27:43 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:27:44.526233 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-028ba650-7e8e-4705-8563-5d9d24eec983 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:44.526899 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-028ba650-7e8e-4705-8563-5d9d24eec983 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:44.533342 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-028ba650-7e8e-4705-8563-5d9d24eec983 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:44.533818 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-028ba650-7e8e-4705-8563-5d9d24eec983 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:44.534562 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-028ba650-7e8e-4705-8563-5d9d24eec983 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:44.534956 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-028ba650-7e8e-4705-8563-5d9d24eec983 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:44.659091 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-028ba650-7e8e-4705-8563-5d9d24eec983 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:44.666907 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-028ba650-7e8e-4705-8563-5d9d24eec983 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 200 len: 1674 microversion: 2.1 time: 0.146108 Oct 13 04:27:44.667482 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 640/1267] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:27:44 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:27:45.690783 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1b9b4cbd-8507-45be-ba60-3bd69d2509da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:45.691731 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1b9b4cbd-8507-45be-ba60-3bd69d2509da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:45.698602 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1b9b4cbd-8507-45be-ba60-3bd69d2509da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:45.699049 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1b9b4cbd-8507-45be-ba60-3bd69d2509da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:45.699806 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1b9b4cbd-8507-45be-ba60-3bd69d2509da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:45.700239 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1b9b4cbd-8507-45be-ba60-3bd69d2509da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:46.050853 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1b9b4cbd-8507-45be-ba60-3bd69d2509da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c76000ef3ee4d9eabd8de600a39badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2312bd342e040f1ade7109084831451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:27:46.058387 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1b9b4cbd-8507-45be-ba60-3bd69d2509da tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 200 len: 1674 microversion: 2.1 time: 0.373241 Oct 13 04:27:46.058936 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 628/1268] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:27:45 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 1674 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:27:46.416519 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-e4284d87-77f7-440a-a8cc-9ab1892f1c0b req-aaa7d57b-6a33-46f0-9808-07460d148f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8300b425-7073-4360-8038-343600de405f", "name": "network-vif-deleted", "tag": "df66c66a-642c-4bce-9c38-ff454176b333"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:27:46.418088 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:27:46.418088 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:27:46.425507 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-e4284d87-77f7-440a-a8cc-9ab1892f1c0b req-aaa7d57b-6a33-46f0-9808-07460d148f27 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:46.426324 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-e4284d87-77f7-440a-a8cc-9ab1892f1c0b req-aaa7d57b-6a33-46f0-9808-07460d148f27 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:46.437278 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-e4284d87-77f7-440a-a8cc-9ab1892f1c0b req-aaa7d57b-6a33-46f0-9808-07460d148f27 service nova] Creating event network-vif-deleted:df66c66a-642c-4bce-9c38-ff454176b333 for instance 8300b425-7073-4360-8038-343600de405f on hv-cinder-81275 Oct 13 04:27:46.442532 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-e4284d87-77f7-440a-a8cc-9ab1892f1c0b req-aaa7d57b-6a33-46f0-9808-07460d148f27 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029569 Oct 13 04:27:46.443111 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 641/1269] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:27:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:27:47.077963 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7df1acbc-69bd-4839-b233-fd286ebcc303 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:47.078568 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-7df1acbc-69bd-4839-b233-fd286ebcc303 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:47.085031 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7df1acbc-69bd-4839-b233-fd286ebcc303 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:47.085527 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7df1acbc-69bd-4839-b233-fd286ebcc303 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:47.086352 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7df1acbc-69bd-4839-b233-fd286ebcc303 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:47.086811 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-7df1acbc-69bd-4839-b233-fd286ebcc303 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:47.101176 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-7df1acbc-69bd-4839-b233-fd286ebcc303 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] HTTP exception thrown: Instance 8300b425-7073-4360-8038-343600de405f could not be found. Oct 13 04:27:47.101812 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-7df1acbc-69bd-4839-b233-fd286ebcc303 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Returning 404 to user: Instance 8300b425-7073-4360-8038-343600de405f could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:27:47.102639 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-7df1acbc-69bd-4839-b233-fd286ebcc303 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 404 len: 111 microversion: 2.1 time: 0.028824 Oct 13 04:27:47.103488 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 629/1270] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:27:47 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:27:47.112145 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-3ed1bc10-8f7e-4b79-b121-198883ed6965 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '.version_select at 0x7f33f6b7f700>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:47.134165 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-3ed1bc10-8f7e-4b79-b121-198883ed6965 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1917577085" status: 202 len: 0 microversion: 2.1 time: 0.026004 Oct 13 04:27:47.135108 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 642/1271] 10.222.0.55 () {58 vars in 1220 bytes} [Wed Oct 13 04:27:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1917577085 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 04:27:50.540679 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8f11e095-681b-4356-b5f1-e56412903c4c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:50.541169 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-8f11e095-681b-4356-b5f1-e56412903c4c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:50.547426 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8f11e095-681b-4356-b5f1-e56412903c4c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:50.547871 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8f11e095-681b-4356-b5f1-e56412903c4c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:50.548634 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8f11e095-681b-4356-b5f1-e56412903c4c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:50.549058 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8f11e095-681b-4356-b5f1-e56412903c4c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:50.562503 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-8f11e095-681b-4356-b5f1-e56412903c4c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] HTTP exception thrown: Instance 8300b425-7073-4360-8038-343600de405f could not be found. Oct 13 04:27:50.563084 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8f11e095-681b-4356-b5f1-e56412903c4c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Returning 404 to user: Instance 8300b425-7073-4360-8038-343600de405f could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:27:50.563901 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-8f11e095-681b-4356-b5f1-e56412903c4c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 404 len: 111 microversion: 2.1 time: 0.026939 Oct 13 04:27:50.564414 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 630/1272] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:27:50 2021] DELETE /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:27:50.572355 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-059a4419-170e-4cf1-a8f5-d7463f91763c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:50.573080 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-059a4419-170e-4cf1-a8f5-d7463f91763c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 8300b425-7073-4360-8038-343600de405f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:50.579328 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-059a4419-170e-4cf1-a8f5-d7463f91763c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:50.579768 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-059a4419-170e-4cf1-a8f5-d7463f91763c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:50.580517 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-059a4419-170e-4cf1-a8f5-d7463f91763c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:50.580941 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-059a4419-170e-4cf1-a8f5-d7463f91763c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:50.594061 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-059a4419-170e-4cf1-a8f5-d7463f91763c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] HTTP exception thrown: Instance 8300b425-7073-4360-8038-343600de405f could not be found. Oct 13 04:27:50.594623 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-059a4419-170e-4cf1-a8f5-d7463f91763c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Returning 404 to user: Instance 8300b425-7073-4360-8038-343600de405f could not be found. {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:27:50.595422 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-059a4419-170e-4cf1-a8f5-d7463f91763c tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f" status: 404 len: 111 microversion: 2.1 time: 0.026866 Oct 13 04:27:50.595935 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 643/1273] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:27:50 2021] GET /compute/v2.1/servers/8300b425-7073-4360-8038-343600de405f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:27:51.739552 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ad770f1d-bcd0-435a-9554-26a033b3571b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:51.740045 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-ad770f1d-bcd0-435a-9554-26a033b3571b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:51.747325 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ad770f1d-bcd0-435a-9554-26a033b3571b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:51.747772 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ad770f1d-bcd0-435a-9554-26a033b3571b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:51.748530 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ad770f1d-bcd0-435a-9554-26a033b3571b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:51.748955 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-ad770f1d-bcd0-435a-9554-26a033b3571b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:51.762304 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-ad770f1d-bcd0-435a-9554-26a033b3571b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] HTTP exception thrown: Instance 6a527ca0-f4d9-4478-8737-56edd7fe83fc could not be found. Oct 13 04:27:51.762883 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-ad770f1d-bcd0-435a-9554-26a033b3571b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Returning 404 to user: Instance 6a527ca0-f4d9-4478-8737-56edd7fe83fc could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:27:51.763690 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-ad770f1d-bcd0-435a-9554-26a033b3571b tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 404 len: 111 microversion: 2.1 time: 0.030073 Oct 13 04:27:51.764197 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 631/1274] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:27:51 2021] DELETE /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:27:51.773588 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2d4ea99d-b5b7-4609-8b4b-f9d010aafd58 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:27:51.774566 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-2d4ea99d-b5b7-4609-8b4b-f9d010aafd58 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] [instance: 6a527ca0-f4d9-4478-8737-56edd7fe83fc] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:27:51.781128 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2d4ea99d-b5b7-4609-8b4b-f9d010aafd58 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:51.781566 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2d4ea99d-b5b7-4609-8b4b-f9d010aafd58 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:51.782344 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2d4ea99d-b5b7-4609-8b4b-f9d010aafd58 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:27:51.782766 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-2d4ea99d-b5b7-4609-8b4b-f9d010aafd58 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:27:51.795739 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-2d4ea99d-b5b7-4609-8b4b-f9d010aafd58 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] HTTP exception thrown: Instance 6a527ca0-f4d9-4478-8737-56edd7fe83fc could not be found. Oct 13 04:27:51.796296 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-2d4ea99d-b5b7-4609-8b4b-f9d010aafd58 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] Returning 404 to user: Instance 6a527ca0-f4d9-4478-8737-56edd7fe83fc could not be found. {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:27:51.797089 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-2d4ea99d-b5b7-4609-8b4b-f9d010aafd58 tempest-AttachVolumeTestJSON-1511444309 tempest-AttachVolumeTestJSON-1511444309-project] 10.222.0.55 "GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc" status: 404 len: 111 microversion: 2.1 time: 0.027316 Oct 13 04:27:51.797598 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 644/1275] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:27:51 2021] GET /compute/v2.1/servers/6a527ca0-f4d9-4478-8737-56edd7fe83fc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:28:49.186627 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8df29e72-94c6-40d2-a913-3f67b48ebfb2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:28:49.187951 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-8df29e72-94c6-40d2-a913-3f67b48ebfb2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:28:49.194611 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8df29e72-94c6-40d2-a913-3f67b48ebfb2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:49.195051 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8df29e72-94c6-40d2-a913-3f67b48ebfb2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:49.195804 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8df29e72-94c6-40d2-a913-3f67b48ebfb2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:49.196224 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8df29e72-94c6-40d2-a913-3f67b48ebfb2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:49.223846 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-8df29e72-94c6-40d2-a913-3f67b48ebfb2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043384 Oct 13 04:28:49.224300 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 632/1276] 10.222.0.55 () {60 vars in 1342 bytes} [Wed Oct 13 04:28:49 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:28:49.287526 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-1aafc934-36e9-4751-9e41-392d5a48392c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:28:49.288054 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-1aafc934-36e9-4751-9e41-392d5a48392c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:28:49.294010 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1aafc934-36e9-4751-9e41-392d5a48392c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:49.294452 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1aafc934-36e9-4751-9e41-392d5a48392c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:49.295204 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1aafc934-36e9-4751-9e41-392d5a48392c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:49.295630 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-1aafc934-36e9-4751-9e41-392d5a48392c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:49.319943 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-1aafc934-36e9-4751-9e41-392d5a48392c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Going to try to terminate instance {{(pid=108260) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:28:49.407817 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-1aafc934-36e9-4751-9e41-392d5a48392c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 204 len: 0 microversion: 2.20 time: 0.123945 Oct 13 04:28:49.408367 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 645/1277] 10.222.0.55 () {60 vars in 1279 bytes} [Wed Oct 13 04:28:49 2021] DELETE /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 04:28:49.418066 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-af600a2d-baa7-471f-b92b-ab0759c57443 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:28:49.418664 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-af600a2d-baa7-471f-b92b-ab0759c57443 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:28:49.424535 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-af600a2d-baa7-471f-b92b-ab0759c57443 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:49.424975 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-af600a2d-baa7-471f-b92b-ab0759c57443 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:49.425750 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-af600a2d-baa7-471f-b92b-ab0759c57443 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:49.426172 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-af600a2d-baa7-471f-b92b-ab0759c57443 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:49.549337 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-af600a2d-baa7-471f-b92b-ab0759c57443 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:28:49.557685 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-af600a2d-baa7-471f-b92b-ab0759c57443 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:28:49.559156 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-af600a2d-baa7-471f-b92b-ab0759c57443 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:28:49.560300 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-af600a2d-baa7-471f-b92b-ab0759c57443 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1720 microversion: 2.20 time: 0.147383 Oct 13 04:28:49.560834 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 633/1278] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:28:49 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:28:50.582001 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b1f55b16-fed0-4f74-83ec-6eb95fd429ca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:28:50.582689 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b1f55b16-fed0-4f74-83ec-6eb95fd429ca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:28:50.589011 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b1f55b16-fed0-4f74-83ec-6eb95fd429ca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:50.589452 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b1f55b16-fed0-4f74-83ec-6eb95fd429ca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:50.590234 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b1f55b16-fed0-4f74-83ec-6eb95fd429ca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:50.590659 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b1f55b16-fed0-4f74-83ec-6eb95fd429ca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:50.722737 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b1f55b16-fed0-4f74-83ec-6eb95fd429ca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:28:50.731248 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b1f55b16-fed0-4f74-83ec-6eb95fd429ca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:28:50.732720 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b1f55b16-fed0-4f74-83ec-6eb95fd429ca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:28:50.733890 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b1f55b16-fed0-4f74-83ec-6eb95fd429ca tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1720 microversion: 2.20 time: 0.156853 Oct 13 04:28:50.734451 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 646/1279] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:28:50 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:28:51.752954 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-cab361ff-2621-40a8-886a-bf6e42a71ff7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:28:51.753531 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-cab361ff-2621-40a8-886a-bf6e42a71ff7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:28:51.759532 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cab361ff-2621-40a8-886a-bf6e42a71ff7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:51.759979 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cab361ff-2621-40a8-886a-bf6e42a71ff7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:51.760749 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cab361ff-2621-40a8-886a-bf6e42a71ff7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:51.761177 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-cab361ff-2621-40a8-886a-bf6e42a71ff7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:51.856154 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-cab361ff-2621-40a8-886a-bf6e42a71ff7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:28:51.864116 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-cab361ff-2621-40a8-886a-bf6e42a71ff7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:28:51.865585 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-cab361ff-2621-40a8-886a-bf6e42a71ff7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6353e635051e487cb5ae8f73097aab5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168ef71e112452db0a5035cfc0e4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:28:51.866753 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-cab361ff-2621-40a8-886a-bf6e42a71ff7 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 200 len: 1653 microversion: 2.20 time: 0.117893 Oct 13 04:28:51.867293 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 634/1280] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:28:51 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 1653 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 04:28:52.111230 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-5b37e0d4-dac5-485d-9905-99ffe8d88285 req-04964c9f-7b4a-4552-ac30-cb4037b9bf4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6451d1-6399-4efc-8b6a-0e57ee0610b8", "name": "network-vif-deleted", "tag": "b7c271f3-64be-4491-904a-f29a7f6c6c8a"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:28:52.113251 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:28:52.113251 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:28:52.121334 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-5b37e0d4-dac5-485d-9905-99ffe8d88285 req-04964c9f-7b4a-4552-ac30-cb4037b9bf4e service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:52.122172 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-5b37e0d4-dac5-485d-9905-99ffe8d88285 req-04964c9f-7b4a-4552-ac30-cb4037b9bf4e service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:52.133943 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-5b37e0d4-dac5-485d-9905-99ffe8d88285 req-04964c9f-7b4a-4552-ac30-cb4037b9bf4e service nova] Creating event network-vif-deleted:b7c271f3-64be-4491-904a-f29a7f6c6c8a for instance 7a6451d1-6399-4efc-8b6a-0e57ee0610b8 on hv-cinder-81275 Oct 13 04:28:52.139416 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-5b37e0d4-dac5-485d-9905-99ffe8d88285 req-04964c9f-7b4a-4552-ac30-cb4037b9bf4e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175841 Oct 13 04:28:52.141925 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 647/1281] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:28:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:28:52.884433 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-493033ad-1956-4503-9458-9b2a20602c6e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:28:52.885047 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-493033ad-1956-4503-9458-9b2a20602c6e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:28:52.891413 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-493033ad-1956-4503-9458-9b2a20602c6e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:52.891856 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-493033ad-1956-4503-9458-9b2a20602c6e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:52.892623 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-493033ad-1956-4503-9458-9b2a20602c6e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:52.893041 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-493033ad-1956-4503-9458-9b2a20602c6e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:52.906675 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-493033ad-1956-4503-9458-9b2a20602c6e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] HTTP exception thrown: Instance 7a6451d1-6399-4efc-8b6a-0e57ee0610b8 could not be found. Oct 13 04:28:52.907260 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-493033ad-1956-4503-9458-9b2a20602c6e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Returning 404 to user: Instance 7a6451d1-6399-4efc-8b6a-0e57ee0610b8 could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:28:52.908208 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-493033ad-1956-4503-9458-9b2a20602c6e tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 404 len: 111 microversion: 2.20 time: 0.027579 Oct 13 04:28:52.908740 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 635/1282] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Oct 13 04:28:52 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 04:28:52.917756 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-494de3e1-67fb-47c9-8c20-53f03a2f5ac9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '.version_select at 0x7f33f6bbd550>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:28:52.938525 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-494de3e1-67fb-47c9-8c20-53f03a2f5ac9 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-142726240" status: 204 len: 0 microversion: 2.20 time: 0.024585 Oct 13 04:28:52.939105 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 648/1283] 10.222.0.55 () {60 vars in 1258 bytes} [Wed Oct 13 04:28:52 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-142726240 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 04:28:54.065120 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d59f537b-54a2-4460-ac72-f8d58f39cb61 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:28:54.065732 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d59f537b-54a2-4460-ac72-f8d58f39cb61 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:28:54.072329 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d59f537b-54a2-4460-ac72-f8d58f39cb61 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:54.072786 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d59f537b-54a2-4460-ac72-f8d58f39cb61 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:54.073559 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d59f537b-54a2-4460-ac72-f8d58f39cb61 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:54.074034 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-d59f537b-54a2-4460-ac72-f8d58f39cb61 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:54.109943 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-d59f537b-54a2-4460-ac72-f8d58f39cb61 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Going to try to terminate instance {{(pid=108259) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 13 04:28:54.191343 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d59f537b-54a2-4460-ac72-f8d58f39cb61 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 204 len: 0 microversion: 2.1 time: 0.131268 Oct 13 04:28:54.192392 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 636/1284] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:28:54 2021] DELETE /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 04:28:54.200513 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7e796433-ff6e-455d-afad-4ef5402e52e6 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:28:54.201240 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7e796433-ff6e-455d-afad-4ef5402e52e6 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:28:54.207578 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7e796433-ff6e-455d-afad-4ef5402e52e6 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:54.208021 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7e796433-ff6e-455d-afad-4ef5402e52e6 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:54.208811 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7e796433-ff6e-455d-afad-4ef5402e52e6 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:54.209238 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7e796433-ff6e-455d-afad-4ef5402e52e6 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:54.346087 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-7e796433-ff6e-455d-afad-4ef5402e52e6 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:28:54.353939 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7e796433-ff6e-455d-afad-4ef5402e52e6 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1576 microversion: 2.1 time: 0.157181 Oct 13 04:28:54.354500 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 649/1285] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:28:54 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:28:54.751961 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-665055fc-44d6-494e-a91c-520d1636e34c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:28:54.752533 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-665055fc-44d6-494e-a91c-520d1636e34c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:28:54.758733 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-665055fc-44d6-494e-a91c-520d1636e34c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:54.759170 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-665055fc-44d6-494e-a91c-520d1636e34c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:54.759921 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-665055fc-44d6-494e-a91c-520d1636e34c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:54.760342 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-665055fc-44d6-494e-a91c-520d1636e34c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:54.774358 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-665055fc-44d6-494e-a91c-520d1636e34c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] HTTP exception thrown: Instance 7a6451d1-6399-4efc-8b6a-0e57ee0610b8 could not be found. Oct 13 04:28:54.774928 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-665055fc-44d6-494e-a91c-520d1636e34c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Returning 404 to user: Instance 7a6451d1-6399-4efc-8b6a-0e57ee0610b8 could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:28:54.775721 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-665055fc-44d6-494e-a91c-520d1636e34c tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 404 len: 111 microversion: 2.1 time: 0.029991 Oct 13 04:28:54.776227 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 637/1286] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:28:54 2021] DELETE /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:28:54.784266 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7b8f3bbd-8326-474a-bad2-67e8cf111e85 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:28:54.784863 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-7b8f3bbd-8326-474a-bad2-67e8cf111e85 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 7a6451d1-6399-4efc-8b6a-0e57ee0610b8] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:28:54.790939 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7b8f3bbd-8326-474a-bad2-67e8cf111e85 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:54.791374 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7b8f3bbd-8326-474a-bad2-67e8cf111e85 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:54.792115 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7b8f3bbd-8326-474a-bad2-67e8cf111e85 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:54.792541 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-7b8f3bbd-8326-474a-bad2-67e8cf111e85 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:54.806498 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-7b8f3bbd-8326-474a-bad2-67e8cf111e85 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] HTTP exception thrown: Instance 7a6451d1-6399-4efc-8b6a-0e57ee0610b8 could not be found. Oct 13 04:28:54.806998 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-7b8f3bbd-8326-474a-bad2-67e8cf111e85 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Returning 404 to user: Instance 7a6451d1-6399-4efc-8b6a-0e57ee0610b8 could not be found. {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:28:54.807787 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-7b8f3bbd-8326-474a-bad2-67e8cf111e85 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8" status: 404 len: 111 microversion: 2.1 time: 0.027383 Oct 13 04:28:54.808287 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 650/1287] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:28:54 2021] GET /compute/v2.1/servers/7a6451d1-6399-4efc-8b6a-0e57ee0610b8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:28:55.372635 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-b0ebc22a-072c-4c8b-bb69-b8e63442f1d2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:28:55.373234 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-b0ebc22a-072c-4c8b-bb69-b8e63442f1d2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:28:55.379823 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b0ebc22a-072c-4c8b-bb69-b8e63442f1d2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:55.380261 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b0ebc22a-072c-4c8b-bb69-b8e63442f1d2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:55.381007 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b0ebc22a-072c-4c8b-bb69-b8e63442f1d2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:55.381432 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-b0ebc22a-072c-4c8b-bb69-b8e63442f1d2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:55.512092 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-b0ebc22a-072c-4c8b-bb69-b8e63442f1d2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:28:55.522436 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-b0ebc22a-072c-4c8b-bb69-b8e63442f1d2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1576 microversion: 2.1 time: 0.153512 Oct 13 04:28:55.523628 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 638/1288] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:28:55 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:28:55.939356 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b339a7f6-1c9c-4087-bc34-a588d40856af tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:28:55.939969 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b339a7f6-1c9c-4087-bc34-a588d40856af tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:28:55.945797 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b339a7f6-1c9c-4087-bc34-a588d40856af tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:55.946233 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b339a7f6-1c9c-4087-bc34-a588d40856af tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:55.946978 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b339a7f6-1c9c-4087-bc34-a588d40856af tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:55.947403 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b339a7f6-1c9c-4087-bc34-a588d40856af tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:55.960838 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-b339a7f6-1c9c-4087-bc34-a588d40856af tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] HTTP exception thrown: Instance 3c2b8a8f-db02-4581-b497-1f4caa68240f could not be found. Oct 13 04:28:55.961401 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b339a7f6-1c9c-4087-bc34-a588d40856af tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Returning 404 to user: Instance 3c2b8a8f-db02-4581-b497-1f4caa68240f could not be found. {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:28:55.962285 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b339a7f6-1c9c-4087-bc34-a588d40856af tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 404 len: 111 microversion: 2.1 time: 0.026735 Oct 13 04:28:55.962774 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 651/1289] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Oct 13 04:28:55 2021] DELETE /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:28:55.973754 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-71014b81-f55a-4e91-8e55-b8b2be71fbf2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:28:55.974500 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-71014b81-f55a-4e91-8e55-b8b2be71fbf2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] [instance: 3c2b8a8f-db02-4581-b497-1f4caa68240f] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:28:55.981986 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-71014b81-f55a-4e91-8e55-b8b2be71fbf2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:55.982469 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-71014b81-f55a-4e91-8e55-b8b2be71fbf2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:55.983350 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-71014b81-f55a-4e91-8e55-b8b2be71fbf2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:55.983811 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-71014b81-f55a-4e91-8e55-b8b2be71fbf2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:55.997425 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.wsgi [None req-71014b81-f55a-4e91-8e55-b8b2be71fbf2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] HTTP exception thrown: Instance 3c2b8a8f-db02-4581-b497-1f4caa68240f could not be found. Oct 13 04:28:55.998020 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-71014b81-f55a-4e91-8e55-b8b2be71fbf2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] Returning 404 to user: Instance 3c2b8a8f-db02-4581-b497-1f4caa68240f could not be found. {{(pid=108259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:28:55.998849 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-71014b81-f55a-4e91-8e55-b8b2be71fbf2 tempest-AttachVolumeShelveTestJSON-1718695074 tempest-AttachVolumeShelveTestJSON-1718695074-project] 10.222.0.55 "GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f" status: 404 len: 111 microversion: 2.1 time: 0.031777 Oct 13 04:28:55.999394 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 639/1290] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:28:55 2021] GET /compute/v2.1/servers/3c2b8a8f-db02-4581-b497-1f4caa68240f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:28:56.549050 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-b8422d5d-8f79-41fd-9888-b4b8a431a016 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:28:56.550460 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-b8422d5d-8f79-41fd-9888-b4b8a431a016 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:28:56.556750 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b8422d5d-8f79-41fd-9888-b4b8a431a016 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:56.557496 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b8422d5d-8f79-41fd-9888-b4b8a431a016 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:56.558556 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b8422d5d-8f79-41fd-9888-b4b8a431a016 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:56.559199 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-b8422d5d-8f79-41fd-9888-b4b8a431a016 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:56.643489 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-b8422d5d-8f79-41fd-9888-b4b8a431a016 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:28:56.651447 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-b8422d5d-8f79-41fd-9888-b4b8a431a016 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 200 len: 1510 microversion: 2.1 time: 0.110838 Oct 13 04:28:56.657779 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 652/1291] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:28:56 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 1510 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:28:56.717262 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-f6d22e15-a9cb-49a1-a5f8-293570ecee38 req-677de200-300e-4392-bd34-0e2f870cb66a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d26bf0b5-5228-42aa-89d4-3965eebb821b", "name": "network-vif-deleted", "tag": "cbed6222-da96-4eeb-bab7-65423ecde122"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:28:56.718998 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:28:56.718998 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:28:56.730574 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-f6d22e15-a9cb-49a1-a5f8-293570ecee38 req-677de200-300e-4392-bd34-0e2f870cb66a service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:56.731787 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-f6d22e15-a9cb-49a1-a5f8-293570ecee38 req-677de200-300e-4392-bd34-0e2f870cb66a service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:56.745222 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-f6d22e15-a9cb-49a1-a5f8-293570ecee38 req-677de200-300e-4392-bd34-0e2f870cb66a service nova] Creating event network-vif-deleted:cbed6222-da96-4eeb-bab7-65423ecde122 for instance d26bf0b5-5228-42aa-89d4-3965eebb821b on hv-cinder-81275 Oct 13 04:28:56.759076 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-f6d22e15-a9cb-49a1-a5f8-293570ecee38 req-677de200-300e-4392-bd34-0e2f870cb66a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045306 Oct 13 04:28:56.760389 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 640/1292] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:28:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:28:57.668159 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-84ac27cf-91d2-4c5a-8b58-e9ce8f21c998 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:28:57.668777 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-84ac27cf-91d2-4c5a-8b58-e9ce8f21c998 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: d26bf0b5-5228-42aa-89d4-3965eebb821b] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:28:57.674685 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84ac27cf-91d2-4c5a-8b58-e9ce8f21c998 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:57.675121 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84ac27cf-91d2-4c5a-8b58-e9ce8f21c998 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:57.675866 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84ac27cf-91d2-4c5a-8b58-e9ce8f21c998 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:57.676284 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-84ac27cf-91d2-4c5a-8b58-e9ce8f21c998 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:57.689890 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.wsgi [None req-84ac27cf-91d2-4c5a-8b58-e9ce8f21c998 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] HTTP exception thrown: Instance d26bf0b5-5228-42aa-89d4-3965eebb821b could not be found. Oct 13 04:28:57.690472 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-84ac27cf-91d2-4c5a-8b58-e9ce8f21c998 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Returning 404 to user: Instance d26bf0b5-5228-42aa-89d4-3965eebb821b could not be found. {{(pid=108260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 13 04:28:57.691306 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-84ac27cf-91d2-4c5a-8b58-e9ce8f21c998 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b" status: 404 len: 111 microversion: 2.1 time: 0.026919 Oct 13 04:28:57.691821 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 653/1293] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:28:57 2021] GET /compute/v2.1/servers/d26bf0b5-5228-42aa-89d4-3965eebb821b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 04:28:57.793118 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1753655921", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-975192895", "security_groups": [{"name": "tempest-secgroup-smoke-70120880"}], "block_device_mapping_v2": [{"uuid": "4565b96e-2114-4ca1-add2-35477273c34e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2425230-f9f9-4ed2-8964-6d1938379dee"}]}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:28:57.960036 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.network.neutron [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] validate_networks() for [('f2425230-f9f9-4ed2-8964-6d1938379dee', None, None, None, None, None)] {{(pid=108259) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 13 04:28:58.852635 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Flavor limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 04:28:58.853190 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Image limits 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 04:28:58.853502 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Flavor pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 04:28:58.853942 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Image pref 0:0:0 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 04:28:58.854347 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.virt.hardware [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 04:28:58.869965 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:58.870651 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:58.872355 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:28:58.872749 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:28:58.891401 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Getting quotas for project 8215b3ac605f4c6ab2b0c473f2de2930. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:28:58.895802 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Getting quotas for user bdcf5f47f87a4c06802f7db012bf8412 and project 8215b3ac605f4c6ab2b0c473f2de2930. Resources: {'ram', 'cores', 'instances'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:28:58.965937 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Going to run 1 instances... {{(pid=108259) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 13 04:28:58.968442 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4565b96e-2114-4ca1-add2-35477273c34e',volume_size=None,volume_type=None)] {{(pid=108259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 13 04:28:59.097870 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [d98f459a-98ec-4845-a791-358094524d5e] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 04:29:00.116440 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO oslo.messaging._drivers.impl_rabbit [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [d98f459a-98ec-4845-a791-358094524d5e] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 45250. Oct 13 04:29:00.122145 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-0f9e2d83-c897-4fc0-bdd4-8340318c1139 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.332687 Oct 13 04:29:00.128232 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 641/1294] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Oct 13 04:28:57 2021] POST /compute/v2.1/servers => generated 404 bytes in 2335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 04:29:00.132676 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-4160c26d-b8bc-43fb-9515-6b9c5b3ae3d5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:00.133370 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-4160c26d-b8bc-43fb-9515-6b9c5b3ae3d5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:00.198929 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-4160c26d-b8bc-43fb-9515-6b9c5b3ae3d5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:00.205477 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-4160c26d-b8bc-43fb-9515-6b9c5b3ae3d5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1094 microversion: 2.1 time: 0.076498 Oct 13 04:29:00.214754 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 654/1295] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:00 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:01.222776 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-349af3dc-95ed-4051-8faf-559f09ee9a99 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:01.223378 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-349af3dc-95ed-4051-8faf-559f09ee9a99 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:01.230377 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-349af3dc-95ed-4051-8faf-559f09ee9a99 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:01.231180 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-349af3dc-95ed-4051-8faf-559f09ee9a99 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:01.232339 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-349af3dc-95ed-4051-8faf-559f09ee9a99 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:01.232907 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-349af3dc-95ed-4051-8faf-559f09ee9a99 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:01.307839 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-349af3dc-95ed-4051-8faf-559f09ee9a99 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:01.316247 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-349af3dc-95ed-4051-8faf-559f09ee9a99 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1210 microversion: 2.1 time: 0.098292 Oct 13 04:29:01.317151 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 642/1296] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:01 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:02.332890 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-96d4ce57-df39-4aea-b984-6bf71b6e45a9 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:02.333590 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-96d4ce57-df39-4aea-b984-6bf71b6e45a9 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:02.339770 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-96d4ce57-df39-4aea-b984-6bf71b6e45a9 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:02.340306 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-96d4ce57-df39-4aea-b984-6bf71b6e45a9 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:02.340981 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-96d4ce57-df39-4aea-b984-6bf71b6e45a9 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:02.341641 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-96d4ce57-df39-4aea-b984-6bf71b6e45a9 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:02.553231 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-96d4ce57-df39-4aea-b984-6bf71b6e45a9 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:02.560882 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-96d4ce57-df39-4aea-b984-6bf71b6e45a9 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.231872 Oct 13 04:29:02.561576 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 655/1297] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:02 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:02.643604 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [req-56620b37-5566-476e-8cc2-04076726ea65 req-1e4155bd-8f0d-4582-a8e3-d70f8a774d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4778e511-bf54-48db-84b5-fa3c72598d07", "tag": "23b41e3f-e8b9-410a-962a-ccc94ccc7379"}]} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:29:02.645983 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:29:02.645983 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: warnings.warn(msg) Oct 13 04:29:02.654819 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-56620b37-5566-476e-8cc2-04076726ea65 req-1e4155bd-8f0d-4582-a8e3-d70f8a774d99 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:02.655435 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [req-56620b37-5566-476e-8cc2-04076726ea65 req-1e4155bd-8f0d-4582-a8e3-d70f8a774d99 service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:02.674314 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.compute.server_external_events [req-56620b37-5566-476e-8cc2-04076726ea65 req-1e4155bd-8f0d-4582-a8e3-d70f8a774d99 service nova] Creating event network-changed:23b41e3f-e8b9-410a-962a-ccc94ccc7379 for instance 4778e511-bf54-48db-84b5-fa3c72598d07 on hv-cinder-81275 Oct 13 04:29:02.679148 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [req-56620b37-5566-476e-8cc2-04076726ea65 req-1e4155bd-8f0d-4582-a8e3-d70f8a774d99 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040188 Oct 13 04:29:02.679752 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 643/1298] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:29:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:29:03.578350 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-fd6d925f-491c-4b9c-93ac-a69bf9e2fb52 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:03.579016 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-fd6d925f-491c-4b9c-93ac-a69bf9e2fb52 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:03.585507 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fd6d925f-491c-4b9c-93ac-a69bf9e2fb52 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:03.585977 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fd6d925f-491c-4b9c-93ac-a69bf9e2fb52 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:03.586747 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fd6d925f-491c-4b9c-93ac-a69bf9e2fb52 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:03.587158 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-fd6d925f-491c-4b9c-93ac-a69bf9e2fb52 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:03.714956 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-fd6d925f-491c-4b9c-93ac-a69bf9e2fb52 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:03.725960 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-fd6d925f-491c-4b9c-93ac-a69bf9e2fb52 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.150923 Oct 13 04:29:03.726792 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 656/1299] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:03 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:04.752750 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-9a51e5b4-8371-4d76-8da4-fef2ac083b84 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:04.753927 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-9a51e5b4-8371-4d76-8da4-fef2ac083b84 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:04.764512 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9a51e5b4-8371-4d76-8da4-fef2ac083b84 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:04.765250 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9a51e5b4-8371-4d76-8da4-fef2ac083b84 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:04.766913 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9a51e5b4-8371-4d76-8da4-fef2ac083b84 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:04.767354 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-9a51e5b4-8371-4d76-8da4-fef2ac083b84 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:04.910863 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-9a51e5b4-8371-4d76-8da4-fef2ac083b84 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:04.918634 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-9a51e5b4-8371-4d76-8da4-fef2ac083b84 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.172751 Oct 13 04:29:04.919166 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 644/1300] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:04 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:05.939329 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-5a87b307-445c-420f-8722-2d84295fead9 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:05.940287 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-5a87b307-445c-420f-8722-2d84295fead9 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:05.950443 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5a87b307-445c-420f-8722-2d84295fead9 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:05.951172 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5a87b307-445c-420f-8722-2d84295fead9 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:05.952403 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5a87b307-445c-420f-8722-2d84295fead9 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:05.953098 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-5a87b307-445c-420f-8722-2d84295fead9 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:06.087560 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-5a87b307-445c-420f-8722-2d84295fead9 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:06.095349 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-5a87b307-445c-420f-8722-2d84295fead9 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.162203 Oct 13 04:29:06.095910 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 657/1301] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:05 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:07.113732 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1ed5605a-867d-4246-933c-a85f4544f5f2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:07.114368 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1ed5605a-867d-4246-933c-a85f4544f5f2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:07.121760 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1ed5605a-867d-4246-933c-a85f4544f5f2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:07.122251 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1ed5605a-867d-4246-933c-a85f4544f5f2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:07.123043 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1ed5605a-867d-4246-933c-a85f4544f5f2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:07.123488 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1ed5605a-867d-4246-933c-a85f4544f5f2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:07.248418 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1ed5605a-867d-4246-933c-a85f4544f5f2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:07.256357 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1ed5605a-867d-4246-933c-a85f4544f5f2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.147155 Oct 13 04:29:07.256914 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 645/1302] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:07 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:08.277553 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-29bf16ca-5fe1-484d-a7bb-3e73d6f6a7bf tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:08.278584 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-29bf16ca-5fe1-484d-a7bb-3e73d6f6a7bf tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:08.286268 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-29bf16ca-5fe1-484d-a7bb-3e73d6f6a7bf tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:08.286708 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-29bf16ca-5fe1-484d-a7bb-3e73d6f6a7bf tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:08.287465 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-29bf16ca-5fe1-484d-a7bb-3e73d6f6a7bf tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:08.287889 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-29bf16ca-5fe1-484d-a7bb-3e73d6f6a7bf tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:08.409344 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-29bf16ca-5fe1-484d-a7bb-3e73d6f6a7bf tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:08.416735 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-29bf16ca-5fe1-484d-a7bb-3e73d6f6a7bf tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.145884 Oct 13 04:29:08.417310 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 658/1303] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:08 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:09.436929 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-a75b9161-a943-43b8-913f-52c397fe5c5c tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:09.437988 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-a75b9161-a943-43b8-913f-52c397fe5c5c tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:09.444862 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a75b9161-a943-43b8-913f-52c397fe5c5c tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:09.445309 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a75b9161-a943-43b8-913f-52c397fe5c5c tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:09.446108 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a75b9161-a943-43b8-913f-52c397fe5c5c tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:09.446533 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-a75b9161-a943-43b8-913f-52c397fe5c5c tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:09.575486 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-a75b9161-a943-43b8-913f-52c397fe5c5c tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:09.583297 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-a75b9161-a943-43b8-913f-52c397fe5c5c tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.152568 Oct 13 04:29:09.583828 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 646/1304] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:09 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:10.603728 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-e65bbf5a-9483-4d1c-8456-024d5992e030 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:10.604689 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-e65bbf5a-9483-4d1c-8456-024d5992e030 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:10.613067 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e65bbf5a-9483-4d1c-8456-024d5992e030 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:10.613544 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e65bbf5a-9483-4d1c-8456-024d5992e030 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:10.614326 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e65bbf5a-9483-4d1c-8456-024d5992e030 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:10.614743 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-e65bbf5a-9483-4d1c-8456-024d5992e030 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:10.740149 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-e65bbf5a-9483-4d1c-8456-024d5992e030 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:10.751731 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-e65bbf5a-9483-4d1c-8456-024d5992e030 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.153991 Oct 13 04:29:10.752459 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 659/1305] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:10 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:11.772958 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-db9334d4-af62-4b4e-90ba-5e4f6c883ad5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:11.774376 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-db9334d4-af62-4b4e-90ba-5e4f6c883ad5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:11.784347 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-db9334d4-af62-4b4e-90ba-5e4f6c883ad5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:11.784794 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-db9334d4-af62-4b4e-90ba-5e4f6c883ad5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:11.785547 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-db9334d4-af62-4b4e-90ba-5e4f6c883ad5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:11.786007 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-db9334d4-af62-4b4e-90ba-5e4f6c883ad5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:11.915002 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-db9334d4-af62-4b4e-90ba-5e4f6c883ad5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:11.923144 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-db9334d4-af62-4b4e-90ba-5e4f6c883ad5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.156672 Oct 13 04:29:11.923702 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 647/1306] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:11 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:12.941894 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-59a44705-5199-435d-9f01-39d4edeb715b tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:12.942637 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-59a44705-5199-435d-9f01-39d4edeb715b tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:12.950264 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-59a44705-5199-435d-9f01-39d4edeb715b tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:12.950848 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-59a44705-5199-435d-9f01-39d4edeb715b tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:12.951833 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-59a44705-5199-435d-9f01-39d4edeb715b tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:12.952397 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-59a44705-5199-435d-9f01-39d4edeb715b tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:13.073398 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-59a44705-5199-435d-9f01-39d4edeb715b tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:13.080708 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-59a44705-5199-435d-9f01-39d4edeb715b tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.143855 Oct 13 04:29:13.081307 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 660/1307] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:12 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:14.098729 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-dace3fed-da5a-4896-9695-76bf08686ce5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:14.099394 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-dace3fed-da5a-4896-9695-76bf08686ce5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:14.105189 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dace3fed-da5a-4896-9695-76bf08686ce5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:14.105633 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dace3fed-da5a-4896-9695-76bf08686ce5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:14.106432 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dace3fed-da5a-4896-9695-76bf08686ce5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:14.106859 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-dace3fed-da5a-4896-9695-76bf08686ce5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:14.237216 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-dace3fed-da5a-4896-9695-76bf08686ce5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:14.244587 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-dace3fed-da5a-4896-9695-76bf08686ce5 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.149619 Oct 13 04:29:14.245290 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 648/1308] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:14 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:15.262349 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-8ae1b21e-c33d-4289-8e38-4018aaa99803 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:15.263096 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-8ae1b21e-c33d-4289-8e38-4018aaa99803 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:15.269491 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8ae1b21e-c33d-4289-8e38-4018aaa99803 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:15.269952 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8ae1b21e-c33d-4289-8e38-4018aaa99803 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:15.270703 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8ae1b21e-c33d-4289-8e38-4018aaa99803 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:15.271120 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-8ae1b21e-c33d-4289-8e38-4018aaa99803 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:15.406918 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-8ae1b21e-c33d-4289-8e38-4018aaa99803 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:15.432743 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-8ae1b21e-c33d-4289-8e38-4018aaa99803 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.173872 Oct 13 04:29:15.433418 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 661/1309] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:15 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:16.454041 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-711fbe14-2990-4cb3-a66c-54f211fe45f3 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:16.454999 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-711fbe14-2990-4cb3-a66c-54f211fe45f3 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:16.465755 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-711fbe14-2990-4cb3-a66c-54f211fe45f3 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:16.466541 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-711fbe14-2990-4cb3-a66c-54f211fe45f3 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:16.467826 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-711fbe14-2990-4cb3-a66c-54f211fe45f3 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:16.468627 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-711fbe14-2990-4cb3-a66c-54f211fe45f3 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:16.603803 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-711fbe14-2990-4cb3-a66c-54f211fe45f3 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:16.611134 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-711fbe14-2990-4cb3-a66c-54f211fe45f3 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.163554 Oct 13 04:29:16.611692 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 649/1310] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:16 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:17.633154 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-0c266015-03e2-4ca2-a139-9c15b1890a03 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:17.634110 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-0c266015-03e2-4ca2-a139-9c15b1890a03 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:17.639725 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e1589c2-9844-4625-ad74-f68a0a288b57] AMQP server on 10.222.0.55:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 13 04:29:17.644530 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0c266015-03e2-4ca2-a139-9c15b1890a03 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:17.644972 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0c266015-03e2-4ca2-a139-9c15b1890a03 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:17.645769 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0c266015-03e2-4ca2-a139-9c15b1890a03 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:17.646193 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-0c266015-03e2-4ca2-a139-9c15b1890a03 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:17.775201 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-0c266015-03e2-4ca2-a139-9c15b1890a03 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:17.783020 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-0c266015-03e2-4ca2-a139-9c15b1890a03 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.157197 Oct 13 04:29:17.783590 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 662/1311] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:17 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:18.802674 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-bce57806-3f81-414e-9b71-47eb868899b8 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:18.803253 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-bce57806-3f81-414e-9b71-47eb868899b8 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:18.810403 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bce57806-3f81-414e-9b71-47eb868899b8 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:18.810907 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bce57806-3f81-414e-9b71-47eb868899b8 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:18.811755 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bce57806-3f81-414e-9b71-47eb868899b8 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:18.812232 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-bce57806-3f81-414e-9b71-47eb868899b8 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:18.937043 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-bce57806-3f81-414e-9b71-47eb868899b8 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:18.945259 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-bce57806-3f81-414e-9b71-47eb868899b8 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.147756 Oct 13 04:29:18.945870 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 650/1312] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:18 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:19.965059 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-acd3769b-16f5-40ff-8aa0-52a53fa6c8d2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:19.965845 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-acd3769b-16f5-40ff-8aa0-52a53fa6c8d2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:19.985311 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-acd3769b-16f5-40ff-8aa0-52a53fa6c8d2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:19.985777 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-acd3769b-16f5-40ff-8aa0-52a53fa6c8d2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:19.986577 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-acd3769b-16f5-40ff-8aa0-52a53fa6c8d2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:19.986998 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-acd3769b-16f5-40ff-8aa0-52a53fa6c8d2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:19.991812 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e1589c2-9844-4625-ad74-f68a0a288b57] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 45422. Oct 13 04:29:20.118831 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-acd3769b-16f5-40ff-8aa0-52a53fa6c8d2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:20.126526 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-acd3769b-16f5-40ff-8aa0-52a53fa6c8d2 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.167340 Oct 13 04:29:20.127093 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 663/1313] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:19 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:21.145648 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-1c0c1c30-e0b6-4827-aade-ac95e14fa936 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:21.146377 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-1c0c1c30-e0b6-4827-aade-ac95e14fa936 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:21.155126 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1c0c1c30-e0b6-4827-aade-ac95e14fa936 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:21.155717 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1c0c1c30-e0b6-4827-aade-ac95e14fa936 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:21.156710 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1c0c1c30-e0b6-4827-aade-ac95e14fa936 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:21.157272 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-1c0c1c30-e0b6-4827-aade-ac95e14fa936 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:21.295895 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-1c0c1c30-e0b6-4827-aade-ac95e14fa936 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:21.303603 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-1c0c1c30-e0b6-4827-aade-ac95e14fa936 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.163012 Oct 13 04:29:21.304164 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 651/1314] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:21 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:21.671814 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-4d992a3a-6a3d-4fee-976e-11535237fbff req-27fc55bd-16a4-4da7-b352-19268803aeba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4778e511-bf54-48db-84b5-fa3c72598d07", "name": "network-vif-plugged", "status": "completed", "tag": "23b41e3f-e8b9-410a-962a-ccc94ccc7379"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:29:21.673381 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:29:21.673381 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:29:21.680417 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-4d992a3a-6a3d-4fee-976e-11535237fbff req-27fc55bd-16a4-4da7-b352-19268803aeba service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:21.680852 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-4d992a3a-6a3d-4fee-976e-11535237fbff req-27fc55bd-16a4-4da7-b352-19268803aeba service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:21.691651 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-4d992a3a-6a3d-4fee-976e-11535237fbff req-27fc55bd-16a4-4da7-b352-19268803aeba service nova] Creating event network-vif-plugged:23b41e3f-e8b9-410a-962a-ccc94ccc7379 for instance 4778e511-bf54-48db-84b5-fa3c72598d07 on hv-cinder-81275 Oct 13 04:29:21.697096 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-4d992a3a-6a3d-4fee-976e-11535237fbff req-27fc55bd-16a4-4da7-b352-19268803aeba service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144031 Oct 13 04:29:21.697589 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 664/1315] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:29:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:29:22.324620 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-46ccce2f-2a05-4a06-9a95-dd405c260061 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:22.325494 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-46ccce2f-2a05-4a06-9a95-dd405c260061 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:22.335549 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-46ccce2f-2a05-4a06-9a95-dd405c260061 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:22.336257 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-46ccce2f-2a05-4a06-9a95-dd405c260061 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:22.337555 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-46ccce2f-2a05-4a06-9a95-dd405c260061 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:22.338323 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-46ccce2f-2a05-4a06-9a95-dd405c260061 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:22.468948 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-46ccce2f-2a05-4a06-9a95-dd405c260061 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:22.476714 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-46ccce2f-2a05-4a06-9a95-dd405c260061 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.158341 Oct 13 04:29:22.477262 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 652/1316] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:22 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:23.498535 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-47f7b284-ccd3-4746-93cc-ea0f1b0f210d tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:23.499656 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-47f7b284-ccd3-4746-93cc-ea0f1b0f210d tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:23.510263 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-47f7b284-ccd3-4746-93cc-ea0f1b0f210d tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:23.510992 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-47f7b284-ccd3-4746-93cc-ea0f1b0f210d tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:23.512223 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-47f7b284-ccd3-4746-93cc-ea0f1b0f210d tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:23.512918 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-47f7b284-ccd3-4746-93cc-ea0f1b0f210d tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:23.644789 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-47f7b284-ccd3-4746-93cc-ea0f1b0f210d tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:23.656316 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-47f7b284-ccd3-4746-93cc-ea0f1b0f210d tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.164290 Oct 13 04:29:23.657101 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 665/1317] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:23 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:24.677499 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-c2036d05-b120-4032-ad2f-6b72190bc48a tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:24.678503 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-c2036d05-b120-4032-ad2f-6b72190bc48a tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:24.688621 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2036d05-b120-4032-ad2f-6b72190bc48a tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:24.689464 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2036d05-b120-4032-ad2f-6b72190bc48a tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:24.690868 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2036d05-b120-4032-ad2f-6b72190bc48a tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:24.691295 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-c2036d05-b120-4032-ad2f-6b72190bc48a tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:24.824088 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-c2036d05-b120-4032-ad2f-6b72190bc48a tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:24.831782 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-c2036d05-b120-4032-ad2f-6b72190bc48a tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.160458 Oct 13 04:29:24.832351 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 653/1318] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:24 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:25.852390 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-f18c9b9c-3750-4e82-8e6f-d037efd605bb tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:25.853379 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-f18c9b9c-3750-4e82-8e6f-d037efd605bb tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:25.863510 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f18c9b9c-3750-4e82-8e6f-d037efd605bb tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:25.863962 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f18c9b9c-3750-4e82-8e6f-d037efd605bb tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:25.864715 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f18c9b9c-3750-4e82-8e6f-d037efd605bb tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:25.865149 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-f18c9b9c-3750-4e82-8e6f-d037efd605bb tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:25.995245 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-f18c9b9c-3750-4e82-8e6f-d037efd605bb tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:26.003330 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-f18c9b9c-3750-4e82-8e6f-d037efd605bb tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.157380 Oct 13 04:29:26.003895 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 666/1319] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:25 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:27.023022 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-5c5e4721-3046-44a5-8cd6-dab81d54cd1a tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:27.024178 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-5c5e4721-3046-44a5-8cd6-dab81d54cd1a tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:27.032031 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5c5e4721-3046-44a5-8cd6-dab81d54cd1a tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:27.032589 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5c5e4721-3046-44a5-8cd6-dab81d54cd1a tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:27.033533 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5c5e4721-3046-44a5-8cd6-dab81d54cd1a tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:27.034110 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-5c5e4721-3046-44a5-8cd6-dab81d54cd1a tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:27.178462 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-5c5e4721-3046-44a5-8cd6-dab81d54cd1a tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:27.185873 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-5c5e4721-3046-44a5-8cd6-dab81d54cd1a tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1264 microversion: 2.1 time: 0.168006 Oct 13 04:29:27.186432 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 654/1320] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:27 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:28.207864 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [None req-d8f284f1-b9b0-4d63-93a1-532ba0667999 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:28.208919 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.compute.api [None req-d8f284f1-b9b0-4d63-93a1-532ba0667999 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108260) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:28.219082 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d8f284f1-b9b0-4d63-93a1-532ba0667999 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:28.219824 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d8f284f1-b9b0-4d63-93a1-532ba0667999 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:28.221083 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d8f284f1-b9b0-4d63-93a1-532ba0667999 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:28.221850 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [None req-d8f284f1-b9b0-4d63-93a1-532ba0667999 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:28.347251 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.policy [None req-d8f284f1-b9b0-4d63-93a1-532ba0667999 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108260) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:28.354744 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [None req-d8f284f1-b9b0-4d63-93a1-532ba0667999 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1451 microversion: 2.1 time: 0.153116 Oct 13 04:29:28.355287 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 667/1321] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:28 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:28.370978 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-8c8fe3ae-0d2c-4860-8fec-9411904a9d52 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Calling method '>' {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 04:29:28.371581 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.compute.api [None req-8c8fe3ae-0d2c-4860-8fec-9411904a9d52 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] [instance: 4778e511-bf54-48db-84b5-fa3c72598d07] Fetching instance by UUID {{(pid=108259) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 13 04:29:28.377719 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8c8fe3ae-0d2c-4860-8fec-9411904a9d52 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:28.378162 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8c8fe3ae-0d2c-4860-8fec-9411904a9d52 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:28.379009 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8c8fe3ae-0d2c-4860-8fec-9411904a9d52 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:28.379431 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG oslo_concurrency.lockutils [None req-8c8fe3ae-0d2c-4860-8fec-9411904a9d52 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:28.503153 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.policy [None req-8c8fe3ae-0d2c-4860-8fec-9411904a9d52 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf5f47f87a4c06802f7db012bf8412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8215b3ac605f4c6ab2b0c473f2de2930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108259) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 04:29:28.511493 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-8c8fe3ae-0d2c-4860-8fec-9411904a9d52 tempest-TestVolumeBootPattern-1874006468 tempest-TestVolumeBootPattern-1874006468-project] 10.222.0.55 "GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07" status: 200 len: 1451 microversion: 2.1 time: 0.144148 Oct 13 04:29:28.512361 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 655/1322] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Oct 13 04:29:28 2021] GET /compute/v2.1/servers/4778e511-bf54-48db-84b5-fa3c72598d07 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 04:29:30.413376 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG nova.api.openstack.wsgi [req-e1c298c2-addd-461e-b34d-e156442bdf14 req-362e9f6e-c544-47da-88ab-3330212333bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4778e511-bf54-48db-84b5-fa3c72598d07", "tag": "23b41e3f-e8b9-410a-962a-ccc94ccc7379"}]} {{(pid=108260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:29:30.414900 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:29:30.414900 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: warnings.warn(msg) Oct 13 04:29:30.421554 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-e1c298c2-addd-461e-b34d-e156442bdf14 req-362e9f6e-c544-47da-88ab-3330212333bd service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 13 04:29:30.422038 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: DEBUG oslo_concurrency.lockutils [req-e1c298c2-addd-461e-b34d-e156442bdf14 req-362e9f6e-c544-47da-88ab-3330212333bd service nova] Lock "44898ae1-31ba-46fa-a097-287ffc9bdaf3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 13 04:29:30.432910 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.compute.server_external_events [req-e1c298c2-addd-461e-b34d-e156442bdf14 req-362e9f6e-c544-47da-88ab-3330212333bd service nova] Creating event network-changed:23b41e3f-e8b9-410a-962a-ccc94ccc7379 for instance 4778e511-bf54-48db-84b5-fa3c72598d07 on hv-cinder-81275 Oct 13 04:29:30.438113 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO nova.api.openstack.requestlog [req-e1c298c2-addd-461e-b34d-e156442bdf14 req-362e9f6e-c544-47da-88ab-3330212333bd service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028324 Oct 13 04:29:30.438661 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: [pid: 108260|app: 0|req: 668/1323] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Oct 13 04:29:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 04:30:28.630585 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.api.openstack.wsgi [None req-d45f0c26-848c-4621-ad5b-cd9c46a045ff tempest-TestShelveInstance-1536296460 tempest-TestShelveInstance-1536296460-project] Action: 'create', calling method: .version_select at 0x7f33ffb0d1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-390993674"}} {{(pid=108259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 04:30:28.648519 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-d45f0c26-848c-4621-ad5b-cd9c46a045ff tempest-TestShelveInstance-1536296460 tempest-TestShelveInstance-1536296460-project] Getting quotas for project 793098bb832542cca3ee20639e740be8. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:30:28.653449 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-d45f0c26-848c-4621-ad5b-cd9c46a045ff tempest-TestShelveInstance-1536296460 tempest-TestShelveInstance-1536296460-project] Getting quotas for user b0346738e5a347958cf39c3178b3ef79 and project 793098bb832542cca3ee20639e740be8. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:30:28.666057 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d45f0c26-848c-4621-ad5b-cd9c46a045ff tempest-TestShelveInstance-1536296460 tempest-TestShelveInstance-1536296460-project] [58b4f971-4ce7-4f36-be28-85cdee3dd29e] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 04:30:29.684410 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO oslo.messaging._drivers.impl_rabbit [None req-d45f0c26-848c-4621-ad5b-cd9c46a045ff tempest-TestShelveInstance-1536296460 tempest-TestShelveInstance-1536296460-project] [58b4f971-4ce7-4f36-be28-85cdee3dd29e] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 46078. Oct 13 04:30:29.774978 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-d45f0c26-848c-4621-ad5b-cd9c46a045ff tempest-TestShelveInstance-1536296460 tempest-TestShelveInstance-1536296460-project] Getting quotas for project 793098bb832542cca3ee20639e740be8. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 13 04:30:29.779727 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: DEBUG nova.quota [None req-d45f0c26-848c-4621-ad5b-cd9c46a045ff tempest-TestShelveInstance-1536296460 tempest-TestShelveInstance-1536296460-project] Getting quotas for user b0346738e5a347958cf39c3178b3ef79 and project 793098bb832542cca3ee20639e740be8. Resources: {'key_pairs'} {{(pid=108259) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 13 04:30:29.794186 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO nova.api.openstack.requestlog [None req-d45f0c26-848c-4621-ad5b-cd9c46a045ff tempest-TestShelveInstance-1536296460 tempest-TestShelveInstance-1536296460-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.374244 Oct 13 04:30:29.794963 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: [pid: 108259|app: 0|req: 656/1324] 10.222.0.55 () {60 vars in 1157 bytes} [Wed Oct 13 04:30:28 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 04:32:25.265374 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 04:32:25.266450 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: Wed Oct 13 04:32:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 13 04:34:05.924190 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 04:34:05.925184 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: Wed Oct 13 04:34:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 13 04:34:17.641772 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 04:34:17.642281 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: Wed Oct 13 04:34:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 13 04:34:30.979946 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 04:34:30.980801 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: Wed Oct 13 04:34:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 13 04:34:30.982017 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 04:34:30.982739 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: Wed Oct 13 04:34:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 13 04:35:45.292020 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 04:35:45.293207 dv-cinder-812751-3-iscsi devstack@n-api.service[108260]: Wed Oct 13 04:35:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 13 04:35:56.720715 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 04:35:56.721730 dv-cinder-812751-3-iscsi devstack@n-api.service[108259]: Wed Oct 13 04:35:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!